Description
Objectives
• Write a bash shell script with bash shell commands to loop through the file
• Write a bash shell script using UNIX commands like awk
• Practice Regex
• Use Google to figure out what you don’t know
• [optional] Experience pair programming (or work alone)
Part 1 Bash Shell Scripts
In this part of the assignment submit 2 separate bash shell scripts that reads in a data file, calculates the average of the scores, sorts the output by last name then first name, and formats the output as shown below. The objective of writing two scripts is to see that there are multiple correct solutions to such problems. One solution should use awk, and the other should use bash commands.
An example data file is shown below:
123456789 Lee Johnson 72 85 90
999999999 Jaime Smith 90 92 91
888111818 JC Forney 100 81 97
290010111 Terry Lee 100 99 100
199144454 Tracey Camp 77 84 84
299226663 Laney Camp 70 74 71
434401929 Skyler Camp 78 81 82
928441032 Jess Forester 85 80 82
928441032 Chris Forester 97 94 89
Write a program that reads in a data file (get filename from command-line arguments) and prints out the average for each person, as shown below based on the example data file above.
71 [299226663] Camp, Laney
80 [434401929] Camp, Skyler
81 [199144454] Camp, Tracey
93 [928441032] Forester, Chris
82 [928441032] Forester, Jess
92 [888111818] Forney, JC
82 [123456789] Johnson, Lee
99 [290010111] Lee, Terry
91 [999999999] Smith, Jaime
Note: we will accept both rounded and truncated averages.
CSCI-3308: Boese
Part 2 Regex
Download the Regex Practice Data (same file from lab).
Then answer the following questions and submit your answers as the regex expression you used, in the text field below.
grep and egrep are your friends (hint: egrep treats { } differently than grep). Be sure to check for word boundaries in your answers ‘\b’ where appropriate.
Pipe answers to “wc –l” to get the count.
There are multiple correct solutions for each of the ones below. I encourage you to explore the variant answers as well for a better understanding of regex.
1. How many lines end with a number?
2. How many lines do not start with a vowel?
3. How many 12 letter (alphabet only) lines?
4. How many phone numbers are in the dataset (format: ‘_ _ _-_ _ _-_ _ _ _’)?
5. How many city of Boulder phone numbers (e.g. starting with 303-_ _ _-_ _ _ _)?
6. How many begin with a vowel and end with a number?
7. How many email addresses are from geocities? (e.g. end with’geocities.com‘)?
8. How many incorrect email address are there (lines with an @ in it but formatted
incorrectly)? An email address has a userid and domain names can consist of
letters, numbers, periods, and dashes. An email address has to have a top-leveldomain
(something.top-level-domain).
Suggestions:
• Talk to each other and use the discussion board to post the numerical answers that you get.
• You can redirect output to a file then run diff between two files to see what the
differences are to help figure out where one solution may be wrong.
Requirements
1. Scripts must be bash files named
o Grades.sh
o GradesAwk.sh
o RegexAnswers.sh
with the first line as: #!/bin/bash
CSCI-3308: Boese
2. The second line in each file is a comment with your name (and your partner’s name if you pair program).
3. For all scripts, read in the name of the data file from command-line arguments.
We will test with additional data files that have different names!
4. Grades scripts:
o The data files for the grades scripts will be the same format as shown, though
it may have more or less lines in the file. All students have 3 grades in the
data files.
o Print out the data with the average, the ID in square brackets, then the last
name, comma, space, first name.
o The output also needs to be sorted, first based on the last name. If the last
name is the same, sort then on the first name. If the person has the same last
name and first name, then sort based on the ID. All IDs are unique in the file.
o If the program is run without one filename as the command-line argument,
print out the usage statement:
Usage: Grades.sh filename
Or
Usage: GradesAwk.sh filename
You may notice that this is how most UNIX commands are set up.
5. Regex program
o Each line of output should map to the question. There are seven questions so
you should only have 7 lines of output which is the output from calling ‘wc –l’
If you do not know how to do one of the answers print out this placement so
that the rest of your answers align in the output:
echo “0”
o If the program is run without one filename as the command-line argument,
print out the usage statement:
Usage: RegexAnswers.sh filename
6. You may pair program, but you may not have more than 2 in your group (only a
group of 2 is permitted or work alone). If you do pair program, then only ONE of you
• Write a bash shell script with bash shell commands to loop through the file
• Write a bash shell script using UNIX commands like awk
• Practice Regex
• Use Google to figure out what you don’t know
• [optional] Experience pair programming (or work alone)
Part 1 Bash Shell Scripts
In this part of the assignment submit 2 separate bash shell scripts that reads in a data file, calculates the average of the scores, sorts the output by last name then first name, and formats the output as shown below. The objective of writing two scripts is to see that there are multiple correct solutions to such problems. One solution should use awk, and the other should use bash commands.
An example data file is shown below:
123456789 Lee Johnson 72 85 90
999999999 Jaime Smith 90 92 91
888111818 JC Forney 100 81 97
290010111 Terry Lee 100 99 100
199144454 Tracey Camp 77 84 84
299226663 Laney Camp 70 74 71
434401929 Skyler Camp 78 81 82
928441032 Jess Forester 85 80 82
928441032 Chris Forester 97 94 89
Write a program that reads in a data file (get filename from command-line arguments) and prints out the average for each person, as shown below based on the example data file above.
71 [299226663] Camp, Laney
80 [434401929] Camp, Skyler
81 [199144454] Camp, Tracey
93 [928441032] Forester, Chris
82 [928441032] Forester, Jess
92 [888111818] Forney, JC
82 [123456789] Johnson, Lee
99 [290010111] Lee, Terry
91 [999999999] Smith, Jaime
Note: we will accept both rounded and truncated averages.
CSCI-3308: Boese
Part 2 Regex
Download the Regex Practice Data (same file from lab).
Then answer the following questions and submit your answers as the regex expression you used, in the text field below.
grep and egrep are your friends (hint: egrep treats { } differently than grep). Be sure to check for word boundaries in your answers ‘\b’ where appropriate.
Pipe answers to “wc –l” to get the count.
There are multiple correct solutions for each of the ones below. I encourage you to explore the variant answers as well for a better understanding of regex.
1. How many lines end with a number?
2. How many lines do not start with a vowel?
3. How many 12 letter (alphabet only) lines?
4. How many phone numbers are in the dataset (format: ‘_ _ _-_ _ _-_ _ _ _’)?
5. How many city of Boulder phone numbers (e.g. starting with 303-_ _ _-_ _ _ _)?
6. How many begin with a vowel and end with a number?
7. How many email addresses are from geocities? (e.g. end with’geocities.com‘)?
8. How many incorrect email address are there (lines with an @ in it but formatted
incorrectly)? An email address has a userid and domain names can consist of
letters, numbers, periods, and dashes. An email address has to have a top-leveldomain
(something.top-level-domain).
Suggestions:
• Talk to each other and use the discussion board to post the numerical answers that you get.
• You can redirect output to a file then run diff between two files to see what the
differences are to help figure out where one solution may be wrong.
Requirements
1. Scripts must be bash files named
o Grades.sh
o GradesAwk.sh
o RegexAnswers.sh
with the first line as: #!/bin/bash
CSCI-3308: Boese
2. The second line in each file is a comment with your name (and your partner’s name if you pair program).
3. For all scripts, read in the name of the data file from command-line arguments.
We will test with additional data files that have different names!
4. Grades scripts:
o The data files for the grades scripts will be the same format as shown, though
it may have more or less lines in the file. All students have 3 grades in the
data files.
o Print out the data with the average, the ID in square brackets, then the last
name, comma, space, first name.
o The output also needs to be sorted, first based on the last name. If the last
name is the same, sort then on the first name. If the person has the same last
name and first name, then sort based on the ID. All IDs are unique in the file.
o If the program is run without one filename as the command-line argument,
print out the usage statement:
Usage: Grades.sh filename
Or
Usage: GradesAwk.sh filename
You may notice that this is how most UNIX commands are set up.
5. Regex program
o Each line of output should map to the question. There are seven questions so
you should only have 7 lines of output which is the output from calling ‘wc –l’
If you do not know how to do one of the answers print out this placement so
that the rest of your answers align in the output:
echo “0”
o If the program is run without one filename as the command-line argument,
print out the usage statement:
Usage: RegexAnswers.sh filename
6. You may pair program, but you may not have more than 2 in your group (only a
group of 2 is permitted or work alone). If you do pair program, then only ONE of you
