Skip to content

completed assignment #655

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kelichiu wants to merge 1 commit into from
Closed

completed assignment #655

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 24 additions & 11 deletions 02_activities/assignments/assignment.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,38 +13,51 @@ if [ -d newproject ]; then
echo "Recreating the newproject directory"
rm -rf newproject
fi

mkdir newproject
cd newproject

mkdir analysis output
touch README.md
touch analysis/main.py

# download client data
curl -Lo rawdata.zip https://github.com/UofT-DSI/shell/raw/refs/heads/main/02_activities/assignments/rawdata.zip
# Download client data
curl -Lo rawdata.zip \
https://github.com/UofT-DSI/shell/raw/refs/heads/main/02_activities/assignments/rawdata.zip

unzip -q rawdata.zip

###########################################
# Complete assignment here

# 1. Create a directory named data
mkdir data

# 2. Move the ./rawdata directory to ./data/raw (eg. move it into ./data and rename it to raw)
# 2. Move the ./rawdata directory to ./data/raw
mv rawdata data/raw

# 3. List the contents of the ./data/raw directory
ls data/raw

# 4. Create the directory ./data/processed,
# then create the following sub-directories within it: server_logs, user_logs, and event_logs

# 5. Copy all server log files (files with "server" in the name AND a .log extension) from ./data/raw to ./data/processed/server_logs
# 4. Create processed directories and their subdirectories
mkdir -p data/processed/server_logs
mkdir -p data/processed/user_logs
mkdir -p data/processed/event_logs

# 6. Repeat the above step for user logs and event logs
# 5. Copy all server log files
cp data/raw/*server*.log data/processed/server_logs/

# 7. For user privacy, remove all files containing IP addresses (files with "ipaddr" in the filename) from ./data/raw and ./data/processed/user_logs
# 6. Copy all user and event log files
cp data/raw/*user*.log data/processed/user_logs/
cp data/raw/*event*.log data/processed/event_logs/

# 8. Create a file named ./data/inventory.txt that lists all the files in the subfolders of ./data/processed
# 7. Remove files containing IP addresses
rm -f data/raw/*ipaddr*
rm -f data/processed/user_logs/*ipaddr*

# 8. Create an inventory of all files in the processed subfolders
find data/processed -type f > data/inventory.txt

###########################################

echo "Project setup is complete!"
echo "Project setup is complete!"
Loading