PythonBasics Flashcards
print working directory
pwd
my computer’s network name
hostname
make directory
mkdir
change directory
cd
list directory
ls
what should you do if you get lost in terminal?
write “pwd” to print working directory and next “cd ~ ” to get back to home
How do you create a folder with multiple words in the name?
write mkdir for creating a folder and then put “” around the name. For example,…. Mkdir “that’s pretty cool”.
remove directory
rmdir
What does “cd ..” do?
it takes you back one folder from for example /desktop/temp/stuff to /desktop/temp, This can also be done for multiple folders back with ../../.. (3 folders back)
What does CLI mean?
Command line interface
What does GUI mean?
graphical user interface
What will “ls -1R” do?
it will show you an overview of all folders below your current position.
push directory
pushd (go to new location)
pop directory
popd (return to saved location)
what does “mkdir -p” do?
lets you create an entire directory at once aka. Multiple folders in a tree. Mkdir -p kap/jokap/chakap/ja/sådan/er/det
copy a file or directory
cp
move a file or directory
mv
What can be the problem if you are not allowed to rmdir a directory?
First of all there could be files within that folder you try to delete. Secondly, if you are 100 % sure that there is nothing, it may be due to the Mac OSX issue of an “.DS_Store” file, which you can delete by going to the folder and write “rm -rf .DS_Store”
page through a file
less
print the whole file
cat
What will
mkdir something
cp awesome.txt something/
Do?
first we create a new folder/directory. Next we make a copy of the file awesome.txt from current pwd to this new folder called “something”
create a new file
touch (write…. “touch iamcool.txt” for example)
How do we copy a file?
go to the directory of the file and write “cp filename.txt newfilesname.text”
execute arguments
xargs
find files
find
how do you rename a file?
use mv (move a file) so you write “mv filename.doc newfilename.doc”. you can check the name change after by listing the directory content with ls
how can you see the content of a file?
write “less filename.txt” and it will show you the content. To quit, just type q
How can you remove a FILE?
just write “rm filename.doc” (you can also remove multiple files at once by listing them)
How can you remove a folder/directory?
rmdir foldername
How can you delete a file within a folder?
rm foldername/filename.txt
How can you delete a folder that contains files?
rm -rf foldername
Whats the “execute” command?
xargs
find things inside files
grep
read a manual page
man
find what man page is appropriate
apropos
look at your environment
env
print some arguments
echo
export/set a new environment variable
export
exit the shell
exit
What is the command to become a super-user?
sudo makes you a super-user and lets you force through more commands
Which command can you use to change the access permissions to a file?
chmod
How can you change the file owner?
use chown
How do you run a python file from terminal?
Just write “python filename.py”
What does # do in python and what is it called?
A hash.
If you put a hash (#) in front of a line of code, it will not print / go in effect so you can use it for making comments
How can you print a hash/octothorpe? “#”
you put it inside strings; print “we have a # inside of the strings now” # the hash inside the strings will be printed but this comment after the second # will not be printed.
What is / called and what is it?
slash and it is the division sign
What is * called and what is it?
asterisk and it is the multiplier sign
How do you make additions?
with “+” for example “print 3 + 2” will output 5
How do you make subtractions?
with “-” for example “print 3 - 4” will output -1
What is “%” and what does it do?
percent and it works as ‘X divided by Y with J remaining’. For example, “100 divided by 16 with 4 remaining” so print “100 % 16” will be 4. While 100 % 10 will be 0.
What are floating point number?
Essentially just numbers that include decimals such as 5.5 or 0.02
What output will print “20/3” give?
6… if you want the precise output including decimals you need to write print “20.0/3.0) and you will get 6.666666666666667
how do you write less-than-equal?
<=
how do you write greater-than-equal?
>=
What is the order of mathematical operations?
PEMDAS, Parentheses, exponents, multiplication, division, addition, subtraction
How do you create a variable in python?
you basically just write out with a “=” sign in-between so for example,
“Cars = 100” # creates a variable that ‘cars’ is equal to 100
“cars_not_driven = cars – drivers” # creates a variable for available cars (cars_not_driven)
What is the difference between = (single-equal) and == (double-equal)?
The = (single-equal) assigns the value on the right to a variable on the left. The == (double-equal) tests if two things have the same value.
Can we write x=100 instead of x = 100?
You can, but it’s bad form. You should add space around operators like this so that it’s easier to read.
How do you define number and character variables?
Examples…
My_name = “Lars Horsbol”
And
My_age = 23
How do you insert variables inside printed text?
you use %s for character-variables and %d for number variables. For example,
Print “Let’s talk about %s” % my_name
And
Print “He’s %d centimeters tall.” % my_age
How should you refer to a number-variable inside printed text?
With %d
Print “He’s %d centimeters tall.” % my_age
How should you refer to a character-variable inside printed text?
With %s
Print “Let’s talk about %s” % my_name
How do you add variables together inside printed text?
You just write them out in the %d.
print “If I add %d, %d, and %d I get %d.” % (my_age, my_height, my_weight, my_age + my_height + my_weight)
here we are trying to add the variables together
How does the %r format work?
If you use %r, it will print no matter what, meaning that it will both print a character-variable (normally %s) and a number-variable (normally %d).
print “and with both character %r AND number %r” % (height, hair) # with %r we will end up printing both the character-variable AND the number-variable
and with both character 192 AND number ‘Dark-blond’
What are the different conversion types in Python and which ones are most common?
%d = signed integer decimal
%s = character-variables
%r = ”print this no matter what”
What’s the point of %s and %d when you can just use %r?
The %r is best for debugging, and the other formats are for actually displaying variables to users.
Can I make a variable like this: 1 = ‘Zed Shaw’?
No, the 1 is not a valid variable name. They need to start with a character, so a1 would work, but 1 will not.
How can we insert a number inside “x = “There are %d types of people” ?
We write “% 10”
x = “There are %d types of people.” % 10 # here we write a string and insert a variable with % outside the string
How can you combine two strings such as:
w = “this is the left side of…“
e = “a string with a right side.” ??
just write; print w + e
How can I round a floating point number?
You can use the round() function like this: round(1.7333) or round(weight / pounds_to_kilo)
Can I use single-quotes or double-quotes to make a string or do they do different things?
In Python either way to make a string is acceptable, although typically you’ll use single-quotes for any short strings like ‘a’ or ‘snow’ and double-quotes for sentences.
Should I use %s or %r for formatting?
You should use %s and only use %r for getting debugging information about something. The %r will give you the “raw programmer’s” version of variable, also known as the “representation.”
Why do you put ‘ (single-quotes) around some strings and not others?
Mostly it’s because of style, but I’ll use a single-quote inside a string that has double-quotes. Look at line 10 to see how I’m doing that.
print “I also said: ‘%s’.” % y
What will; print “.” * 10 do?
this will result in 10*. So the output will be; ……….
If, end1 = “C”
end2 = “h”
end3 = “e”
end4 = “e”
end5 = “s”
end6 = “e”
end7 = “b”
end8 = “u”
end9 = “r”
end10 = “g”
end11 = “e”
end12 = “r”,
what will;
print end1 + end2 + end3 + end4 + end5 + end6
print end7 + end8 + end9 + end10 + end11 + end12
result in?
Just.
Cheese
burger
On two different lines because there is no comma after “end6”.
Why do I have to put quotes around “one” but not around True or False?
That’s because Python recognizes True and False as keywords representing the concept of true and false. If you put quotes around them, then they are turned into strings and won’t work right.
If, end1 = “C”
end2 = “h”
end3 = “e”
end4 = “e”
end5 = “s”
end6 = “e”
end7 = “b”
end8 = “u”
end9 = “r”
end10 = “g”
end11 = “e”
end12 = “r”,
what will;
print end1 + end2 + end3 + end4 + end5 + end6,
print end7 + end8 + end9 + end10 + end11 + end12
result in?
Just.
Cheese burger
On two different lines because there is a comma after “end6” it stays on the same line in the printed output.
What will; print “Its fleece was white as %s.” % ‘snow’ result in?
Its fleece was white as snow.
If you have; formatter = “%r %r %r %r” , what will happen if you write print formatter % (formatter, formatter, formatter, formatter)
‘%r %r %r %r’ ‘%r %r %r %r’ ‘%r %r %r %r’ ‘%r %r %r %r’
If you have; formatter = “%r %r %r %r” , what will happen if you write;
print formatter % (
“I had this thing.”,
“That you could type up right.”,
“But it didn’t sing.”,
“So I said goodnight.”
)
‘I had this thing.’ ‘That you could type up right.’ “But it didn’t sing.” ‘So I said goodnight.’
Why do I have to put quotes around “one” but not around True or False?
That’s because Python recognizes True and False as keywords representing the concept of true and false. If you put quotes around them, then they are turned into strings and won’t work right.
I tried putting Chinese (or some other non-ASCII characters) into these strings, but %r prints out weird symbols.
Use %s to print that instead and it’ll work.
Why does %r sometimes print things with single-quotes when I wrote them with double-quotes?
Python is going to print the strings in the most efficient way it can, not replicate exactly the way you wrote them. This is perfectly fine since %r is used for debugging and inspection, so it’s not necessary that it be pretty.
Why do the \n newlines not work when I use %r?
That’s how %r formatting works; it prints it the way you wrote it (or close to it). It’s the “raw” format for debugging.
What are two ways to make a string that goes across multiple lines?
- You can use \n è “nJan\nFeb\nMar\nApr\nMay\nJun\nJul\nAug”
- You can use a triple double quote “”” ………… “””
What will making three double-quotes allow you to do? “”” “””
Write a lot of text within the “”” here “”” on multiple different lines
print “””
There’s something going on here.
With the three double-quotes.
We’ll be able to type as much as we like.
Even 4 lines if we want, or 5, or 6.
”””
How do you write some text that is tabbed in?
Like this?
You use; \t so for example
Print “\tI’m tabbed in.”
How do you write a string of text and then split the text on different lines?
You use \n so for example…
Print “I’m split\non a line.”
Will become;
I’m split
On a line
What will; print “I’m \ a \ cat.” ; result in?
I’m \ a \ cat
So it removes one of the backlashes
How can you produce a list of points?
What does the escape sequences \ do?
What does the escape sequence \’ do?
What does the escape sequence; \a do?
It inserts an extra space.
So;
Print “hey man\a whats up”
Becomes
Hey man whats up
What does the escape sequence \b do?
What does the escape sequence \n do?
What does the escape sequence \r do?
What does the escape sequence \t do?
When I use a %r format none of the escape sequences work.
That’s because %r is printing out the raw representation of what you typed, which is going to include the original escape sequences. Use %s instead. Always remember this: %r is for debugging; %s is for displaying.
What is the function of the comma in this:
print “How old are you?”,
age = raw_input()
the function of the comma is to make sure that the output is on the same line.
With comma we get; How old are you? 23
Without comma we get: How old are you?
23
What is raw_input in python and what is it useful for?
Raw_input lets you interact with the outside world to get input. The raw_input() function waits for the user to type some input and press return. It then gets whatever was typed.
(called input() in python 3 but here it also tries to convert the input whereas rawinput from python 2 simply takes the raw input which is usually easier to work with/safer)
How can you insert prompts for raw_input requests?
Just write questions or prompts inside the string of the raw_input() like this;
height = raw_input(“How tall are you? Fx. 1.82 m”)
How can you look up what any function in python does from within the terminal?
Why would I use %r over %s?
Remember, %r is for debugging and is “raw representation” while %s is for display. I will not answer this question again, so you must memorize this fact. This is the #1 thing people ask repeat- edly, and asking the same question over and over means you aren’t taking the time to memorize what you should. Stop now, and finally memorize this fact.
What do you also call a “.py” file?
A script
What are modules?
Modules are features you can add in your python script. Some people also called modules for libraries.
It could for example be: sys and argv
Python filename.py arg1 arg2 arg3
So for example
Python e13.py I want snacks
Will give…
The script is called: e13.py
Your first variable is: i
Your second variable is: want
Your third variable is: snacks
What happens if you input less arguments for argv when trying to run in the command line?
What’s the difference between argv and raw_input()?
The difference has to do with where the user is required to give input. If they give your script inputs on the command line, then you use argv. If you want them to input using the keyboard while the script is running, then use raw_input().
How can you use raw_input prompts for multiple places in your script?
Does txt = open(filename) return the contents of the file?
No, it doesn’t. It actually makes something called a “file object.” You can think of it like an old tape drive that you saw on mainframe computers in the 1950s or even like a DVD player from today. You can move around inside them, and then “read” them, but the file is not the contents
What does from sys import argv mean?
For now, just understand that sys is a package, and this phrase just says to get the argv feature from that package. You’ll learn more about these later.
Why is there no error when we open the file twice?
Python will not restrict you from opening a file more than once, and in fact sometimes this is necessary.
Which command will let you close files?
Close
Which command will let you read files?
Read
Which command will let you open files?
Open
Which command will let you read just one line?
Readline
Which command will let you empty a file for its content? (be careful)
Truncate
Which command will let you write stuff into your file?
Write(stuff)
What could we write to open a file? (existing or not)
What could we write to open and read a file?
What does the file modes “r” do in python?
This is the default mode. It Opens file for reading.
What does the file modes “w” do in python?
This Mode Opens file for writing.
If file does not exist, it creates a new file.
If file exists it truncates the file.
What does the file modes “x” do in python?
Creates a new file. If file already exists, the operation fails.
What does the file modes “a” do in python?
Open file in append mode.
If file does not exist, it creates a new file.
What does the file modes “t” do in python?
This is the default mode. It opens in text mode.
What does the file modes “b” do in python?
This opens in binary mode.
What does the file modes “+” do in python?
This will open a file for reading and writing (updating)
How can you write a simple script that will open a file specified in command/terminal?
If you open the file with ‘w’ mode, then do you really need the target.truncate()?
No. It doesn’t make any difference as the “w-mode” will overwrite the existing file so emptying that file first makes no difference.
Does just doing open(filename) open it in ‘r’ (read) mode?
Yes, that’s the default for the open() function.
What can the “import” statement do?
With the import statement we can import new modules to python.
Some modules/functions are existing in your python program already, but sometimes you may want to add new functions. Here, it can be smart to import code written by others than to innovate yourself. You can import such new modules with the import statement.
Why do you have to do output.close() in the code when the file is already closed?
It is good practice to always close files so you avoid later commands working with those files from reading descriptions from those closed files.
What does the len() function do?
It gets the length of the string that you pass to it and then returns that as a number. Play with it.
What do functions do? (put simply)
- They name pieces of code the way variables name strings and numbers.
- They take arguments the way your scripts take argv.
- Using #1 and #2, they let you make your own “mini-scripts” or “tiny commands.”
Think of “function” as a mini-script
How do you create a function in python?
Write; def (for define)
The first function is overly complicated. It takes the look of when we work with args and does uses *args inside print_two. On the line below, it unpacks those args to finally print it.
There is no need to do this unpacking. We can simply put arg1, arg2 inside the function from the beginning.
How should you start a function?
- With; def (for definition)
- And then open paranteheses right after the function name
- And list the arguments comma separated
- End the parantehese AND add a colon:
def print_three(arg1, arg2, arg3):
How should your function name be?
It should only use characters AND underscore so for example
Print_two_again
How many spaces should the lines of code in a function be indented?
4 characters. No more, no less.
This usually happens automatically in your script-writing program
How do you end a function? (stop adding more to it)
What does it mean to run a function?
The same as to “use” or to “call” a function
What does it mean to call a function?
The same as to “run” or to “call” a function
What does it mean to call a function?
The same as to “use” or to “use” a function
What’s allowed for a function name?
Just like variable names, anything that doesn’t start with a number and is letters, numbers, and underscores will work
What does the * in *args do?
That tells Python to take all the arguments to the function and then put them in args as a list. It’s like argv that you’ve been using, but for functions. It’s not normally used too often unless specifi- cally needed.
Are functions and variables connected?
No. The functions you write in your script are not connected to the variables.
it will print:
We can just give the function numbers directly:
You have 20 cheeses!
You have 30 boxes of crackers!
Man that’s enough for a party!
Get a blanket.
As it will first “We can just give the function numbers directly:” and then all the content of the function (def) Cheese_and_crackers below it.
How should you write up an user-input-variable making sure that it will be an integer result?
Put raw_input inside int() for integer
For example
Eaten_packages = int(raw_input(“How many packages did you eat by now? “))
Is there a limit to the number of arguments a function can have?
It depends on the version of Python and the computer you’re on, but it is fairly large. The practical limit, though, is about five arguments before the function becomes annoying to use.
What does f.seek do?
The seek-function takes the “cursor” (or point of the mouse so to say) to a certain place in a file. For example, we take it to the very beginning with f.seek(0) so we are at the start of the file again
What does += do?
+= adds another value with the variable’s value and assigns the new value to the variable.
+= adds a number to a variable, changing the variable itself in the process (whereas + would not).
It adds the right operand to the left. x += 2 means x = x + 2
What does -= do?
+= subctracts a number from a variable, changing the variable itself in the process (whereas - would not).
It subtracts the right operand from the left. x -= 2 means x = x - 2
What does *= do?
*= multiplies a number with a variable, changing the variable itself in the process (whereas * would not).
It multiplies the right operand with the left. x *= 2 means x = 2x
What does /= do?
/= divides a variable with a number, changing the variable itself in the process (whereas / would not).
It divides the right operand with the left. x /= 2 means x = x/2
What does %= do?
%= finds modulus of a variable with a number, changing the variable itself in the process (whereas % would not). Modulus = the remainder when dividing.
It finds modulus so: x %= 3 means x = modulus of x/3
How does readline() know where each line is?
Inside readline() is code that scans each byte of the file until it finds a \n character, then stops reading the file to return what it found so far. The file f is responsible for maintaining the current position in the file after each readline() call, so that it will keep reading each line.
What does the return statement do/how does it work?
The RETURN statement writes out what it does to the user AND can also be used by other functions
The PRINT statement simply writes out what’s inside but cannot be used by other functions
Example explanation:
Def returnFunction(num):
Num = num *2
Return num
Def printFunction(num):
Num = num *2
Print(num)
If we write…
returnFunction(4)
we get an output of; 8
if we write….
printFunction(4)
we get an output of; 8
So as such they look the same.
But.. heres the difference.
X = returnFunction(4)
X #notice this one
8
Y = printFunction(4)
8
So the return function gives us “x” but the print-function doesn’t give us anything so we cannot use it later.
If we in python now ask for x we will get 8 but if we ask for y we won’t get anything.
How can I use raw_input() to enter my own values?
Remember int(raw_input())? The problem with that is then you can’t enter floating point, so also try using float(raw_input()) instead.
What does “return” mean?
It’s the same as “output”. Synonyms.
How do you write comments in python?
Write # and everything here after the hashtag will not be shown. It is called HASH or and OCTOTHORPE
But you can still write an octothorpe inside strings like:
Print “here we # like to go on Instagram”
How do you print some text that is followed by maths?
Remember to put a comma…
Print “Hens”, 25 + 5
Will return
Hens 30
Or
Print “What is 3 + 2?”, 3 +2
Will return
What is 3 + 2? 5
How do we create a variable in python?
Simple use =
For example
Cars = 100
What does %r do?
If you use %r, it will print no matter what, meaning that it will both print a character-variable (normally %s) and a number-variable (normally %d).
print “and with both character %r AND number %r” % (height, hair) # with %r we will end up printing both the character-variable AND the number-variable
and with both character 192 AND number ‘Dark-blond’
How can we repeat a printed string?
Just write asterisk and the number of times you want to repeat it. For example:
Print “.” * 20
Will return
………………..
How do you write a list of things but on different lines?
Use \n
For example:
Months = ‘Jan\nFeb\nMar\nApr\nMay\nJun\nJul\nAug’
Print “Here are the months: “, months
How can you tab in some printed text?
Use \t
So for example
Print “””
I’ll do a list:
\t* Sugar
\t* Spice
\t* And everything nice
Will return
I’ll do a list
- Sugar
- Spice
- And everything nice
How can you ask users to input information/answer questions?
Use raw_input()
For example…
Print “How old are you?”,
Age = raw_input()
remember the comma after print
What do you need to do before you can use arguments?
Import argv by writing…
From sys import argv
Can you write strings inside raw_input()?
Yes. This is called a prompt. Help for the answer
For example
Print “What’s your birthday? “,
Raw_input(“DD-MM-YYYY” )
How do you define what your arguments are?
Write first the argument inoputs such as…
Script, filename = argv #script name and filename is defined here.
How can we create AND open a file at the same time?
note… you must define filename.
Open(filename, “w”)
How do you delete the contents of a file?
Target.truncate()
How do you write something into a file through your script?
Target.write()
How do you close a file?
Target.close()
How do you create a line break?
\n
How we get the number of bytes a file is long?
Len()
How do we open and read a file in the same line of code?
note you must define from_file
open(from_file, “r”)
How do you tell python that there is a function inside a certain file?
First you open command and run “python”
Then you “import file1” (whatever file it is)
And then tell python to run a certain function within “file1” by adding “dot” and the function’s name. For example:
E25.print_last_word(sorted_words)
How do you incorporate help statements in your python functions and later display them in command?
break_words(stuff)
This function will break up word for us.
print_first_and_last(sentence)
Prints the first and last words of the sentence.
print_first_and_last_sorted(sentence)
Sorts the words then prints the first and last one.
print_first_word(words)
Prints the first word after popping it off.
print_last_word(words)
Prints the last word after popping it off.
sort_sentence(sentence)
Takes in a full sentence and returns the sorted words.
sort_words(words)
Sorts the words.
What is a list?
lists
- consist of a countable number of ordered values
- fruits = [’orange ’ , ’apple ’ , ’pear ’ , ’banana ’ , ’kiwi’, ’apple’, ’banana’]
What is a tuple?
- Immutable: Cannot be changed
- The advantage is that you will know the position of the elements better and thus also make it easier for the computer to locate elements: provides for speed
- You use it when you know that a variable will not change (e.g. days of the week)
- Values are separated by commas
- v = (’a’, ’b’, ’c’)
What is a set?
sets
- unordered collection
- NO duplicate elements
- basket = {’apple’, ’orange’, ’apple’, ’pear’, ’orange’, ’banana’}
What is a dictionary?
dictionary
- a set of keys: value pairs in which each key is unique
- tel = {’jack’: 4098, ’john’: 4139}
What are classes and objects/instances?
classes are used to create new user-defined data structures that contain arbitrary information about something. Class is generic.
- Class: Dog
- species = ’mammal ’
an object/instance is a copy of the class with actual values (thus you have 1 class and multiple instances). Object/instance is specific.
- Instance/object:
- def __init__(self , name, age): self .name = name
- self .age = age
Will these two turn out the same results?
What is the difference between for- and while loops?
- For-loops you know in advance the number of times it will execute. This is unknown with while-loops as it executes as long as the Boolean condition is True
- Use a for-loop for definite iterations = if you know the maximum number of times that you need to execute the code
- Use a while-loop if you require to repeat some computation until a condition is met that you cannot calculate in advance (needed for probabilistic results and human intervention)
what does a break statement do?
a break statement is used to immediately finish a loop.
(this is considered bad practice though)
what does a continue statement do?
a continue statement causes to skip the processing of the rest of the code for a loop BUT the loop continues with the subsequent iterations of the loop
(this is considered bad practice though)
What does “syntax error” refer to?
- Missing punctuation characters, such as parentheses, quotation marks or commas
What does “TypeError” refer to?
- when you try to combine to incompatible items
What does “NameError” refer to?
- Normally when you have used a variable before assigning it a value
What does “ValueError” refer to?
- When the value passed to a function is not compatible with the function.
- in the example as string inserted as if it was to be converted to an integer
What is the standard format to ask for help in programming communities?
TIRTBV
- Title
- Introduce
- Reproduce (others should be able to reproduce)
- Tags
- Background
- Version
How can you take the sqrt of numbers in python?
What is the difference between “a = 2” and “a == 2”?
A = 2 is defining a as 2
A == 2 is asking whether a is equal to 2 or not
What are 3 good rules for naming variables?
- Names can not start with a number
- Use _ when using space
- Do not use capital letter (best practice is lowercase)
What are the 3 types of variables?
- Float
- Integer
- Boolean
How do you make addition, subtraction, multiplication, diversion, power functions and modulo?
- Addition (i.e. +)
- Substraction (i.e. -)
- Multiplication (i.e. *)
- Division (i.e. /)
- Power functions (i.e. **)
- Modulo (i.e. %)
What is a possible reason why (0.1+0.2-0.3) equals 5.551115123125783e-17 instead of 0?
The numbers have not been rounded and are only showing with one decimal.
To turn to 0 write: round(0.1+0.2-0.3)
How do you get the number of characters in a string?
Count number of characters in “Hello world”
my_text = ‘Hello world’
len(my_text)
11
What will….
my_text = ‘Hello world’
print(my_text[7])
return?
O
H = 0, e = 1, 2 = l, 3=l, o=4, “ “ = 5, w=6, o=7
If, my_text = ‘Hello world’, how can you write it out as both capital letters, small-case letters and as two different strings?
How can you reverse the order of a list?
If…
a = {‘a’,’b’,’c’,’d’}
b = {‘b’,’c’,’e’}
find all the elements in a and b result={‘a’, ‘b’, ‘c’, ‘d’, ‘e’}
a | b
If.. my_list = [1,2,3,4,2,2,2,2,5,5,5,5,9,9,9] how do we find the number of unique elements and how do we create set of these unique numbers?
len(set(my_list))
6
set(my_list)
{1, 2, 3, 4, 5, 9}
Write a loop that prints string characters one by one
How can you…x^2: x in {0,1,2,…10}?
Implement a x^4 in two nested comprehesion (x^2… then x^2)
Create a function that prints a hello and a name of the person
Write a program that outputs the first recurring character in a string.
myString = “ABCDEBC”
What is the standard way to define a function in python (5 elements)?
How you close a file?
write the specified name.close()
How do you search for files that match a particular pattern, such as ‘.csv’?
You can use…
endswith()
startswith()
fnmatch.fnmatch()
Retrieve all files and directories starting with ‘Py’
What is the “finally” clause used for?
What is an array?
- An array is a data structure consisting of a collection of values, each one identified by at least one positive index (can have more than one dimension; matrixes)
- all values have the same type (int, float….)
- (array = objects, ndarray = class name of these objects)
- each element within this is a “dtype” (data-type) element in NumPy
What are the parameters in array slicing?
[start:stop:step]
How do you slice ndarrays with more than one dimension?
What is a series in Panda?
A series is a one-dimensional labeled array and can be created using the following code
What is the difference between syntax errors and exceptions?
- Syntax errors occur when the parser detects an incorrect statement
- An exception error occurs whenever syntactically correct python code results in an error
How can you insert an exception?
What are assertions and how can they be used?
Assertions are a systemic way to check that the inputs in a program are as expected by the program to avoid running into exception errors.
Often useful for:
- checking parameter types, classes or values,
- checking “can’t happen” situations such as dividing by 0
- after calling a function to make sure that its return is reasonable
assert condition, error_message
What is the “finally” clause for in python?
To implement some sort of action to clean up after executing a code.
What is a DataFrame in Panda?
How do the different merge operations in Pandas look visually?
- Natural join
- full outer join
- left outer join
- right outer join
What will….
for i in range(2, 10, 2):
print(i)
result in?
you can also rename the function at the same time…
from fibo import fib_print as fibonacci
How can you Retrieve all files and directories starting with ‘Py’?
How can you Retrieve all .py files?
How could study the efficiency of your code?
Use the “time()” function in python to check the time it takes for your code to run.
How does a NumPy array of (3.7) look AND how can you make it?
NumPy takes rows FIRST and SECONDLY columns.
What will happen if you try to create an array from the following python list… x = [(1, 2, 3), (4, 5)]?
it basically fails as the second list only contains two elements.
Slicing multidimensional array (NumPy). How would you get [5, 6] from the following array?
a[-1][-2:]
returns… array ([5, 6])
why?
you basically have…
What will np.ones((3, 3)) + np.arange(3) return?
this is broadcasting…
Here we first create np.ones((3,3)) which is
1, 1, 1
1, 1, 1
1, 1, 1
and then np.arange(3) on top of it so it is increasing by adding 0, then 1, then 2.
What will np.arange(3).reshape((3, 1))+np.arange(3) return?
this is broadcasting…
np.arange(3) is..
0, 1, 2
BUT…. it is reshaped to 3 rows, 1 column… so…
0
1
2
and then we add another np.arange(3) to it…
0, 1, 2
and combine to…
0, 1, 2
1, 2, 3
2, 3, 4
How can you get information about a file in pandas?
if the file name is titanic.csv
titanic.info()
will return
How can you get descriptive statistics?
if the file name is titanic.csv
titanic.describe()
What are the components in making a histogram?
- titanic.hist(
- bins = # the width of bars (lower is wider)
- figsize=(16, 9) #is the proportions of the figures
- grid=False #whether you want a grid or not
- plt.show() #and then show the histogram
How do you make a histogram of the data within a specific column?
titanic. Age.hist(bins = 50, figsize=(12, 6), grid=True)
plt. xlabel(‘Age’)
plt. ylabel(‘Number of people’)
plt. show()
If we just define a series as, c = pd.Series([1956, 1967, 1989, 2000]), what will the index be?
when not specifying the index, they will simply be a sequence of integers starting from 0.
0, 1, 2, 3 in this case
How can we specify the index for the following series, c = pd.Series([1956, 1967, 1989, 2000])?
What are the ‘head’ and ‘tail’ methos for?
Helps show the first (by default = 5) rows in a dataset so we can see how the data looks.
If you insert a number in head(), you will get that number of rows instead of the default 5 rows.
The tail() method is the opposite in the way that it gives you the LAST 5 rows.
How can you get the names of the columns and rows in a DataFrame?
filename.columns
and
filename.index
what is the difference between writing edu.max(axis=0) and edu.max(axis=1)?
axis = 0 finds the maximum value for each column (finding max within the rows for each column)
while
axis = 1 find the maximum value for the row (finding max within the column for each row)
What is the difference between pandas and pythons interpretation of NaN?
In Python ,NaN values propagate through all operations without raising an exception. In contrast, Pandas operations exclude NaN values representing missing data. For example, the pandas max function excludes NaN values, thus they are interpreted as missing values, while the standard Python max function will take the mathematical interpretation of NaN and return it as the maximum:
What is a lambda function?
It is essentially just a function without a name.
It is written in-line.
For example…
What is the following doing?
edu[“ValueNorm”] = edu[‘Value’]/edu[‘Value’].max()
edu.tail()
we are defining a new column called ‘ValueNorm’ by taking ‘Value’/the highest number in the ‘Value’ column
lastly we ask to see the 5 last rows of the updated DataFrame using tail()
How can you insert a new row at the bottom of a DataFrame?
using the append function, which receives as argument the new row represented as a dictionary where the keys are the name of the existing columns and the values the associated values.
It is important to the the ignore_index flag to True, otherwise the index 0 is given to this new row which will produce an error if it already exists (may potentially overwrite if not set to True)
How can you easily delete the last row in a Dataframe?
simply use the drop and max functions. Why max? because then we will be taking the last row if the index is ordered at least.
How can we fill in NaN values?
using fillna()
eduFilled = edu.fillna(value={‘Value’:0})
will fill in the NaN with 0 instead but be careful about doing so will change the statistics of your data when using pandas.
What will the following give us?
edu. sort_values(by=’Value’, ascending= False,inplace=True)
edu. head()
here we are using the sort function to sort the data
by
‘Value’ and NOT in ascending order (then it must be descending order), meaning that we will get the 5 highest values as we use edu.head() which by default give 5 rows.
What will the following give us?
here we are using groupby to group some data.
we are clearly interested in GEO (countries) and the values.
We are grouping by Geo (country) and asking for the mean of values for each country.
next, we ask pandas to sort this data by values in a descending order.
What is the following doing?
- first we are filtering the data with a boolean expression asking for data dated later than 2005 from the TIME column
- secondly, we use the pd.pivot_table function to rearrange our data such that the index/rows become GEO/countries and columns will be equal to time (the time values newer than 2005 as we are using the filtered data)
- lastly we ask to see the first 10 rows
say you have a list of numbers
numbers = [33, 44, 55, 66, 77, 88]
what are the two ways that we can remove 44 from the list?
[33, 44, 55, 66, 77, 79, 88, 79]
how can you add multiple values to an existing list?
How do you swap the values of the
a = 5
b = 6
How do you swap the values of the
two variables below in the easiest way?
c = 10
d = 15
how can you print ejendomsinvestoren 5 times?
How can you print each even number from 0 to 100?
how can you print all numbers from 1 to 100
but excluding those that are divisible by 3 and 5?
How would you create the following:
####
####
####
####
?
How would you create the following:
#
##
###
####
?
How would you create the following:
####
###
##
#
?
What does it mean to use FOR ELSE?
To make a for-loop in which you have an if-elif-else statement WHERE the “else” IS NOT indented.
say we have a list of numbers
nums = [12, 15, 18, 23, 26]
What is TypeCode used for?
You use TypeCode to specify which type the values are of for an ARRAY
import array
array.array(‘b’, [5, 7, 8, 10])
how can you ask a user to enter values to an array?
copying an array in python SAME ID
how can you add two arrays?
how can you make two arrays into one long array?
copying an array in python DIFFERENT ID
how can you convert a 2d-array into 1d-array?
multi-dimensional arrays…
how can you convert a 2d-array into 3d-array?
multi-dimensional arrays…
define a simple function and call it “greet”
define a function that can add two numbers
Create a function that can sum an unknown amount of numbers
What is the difference between a local and global variable?
How can you pass a LIST to a function in Python and count #odd and #even?
How can you create a Fibonacci Sequence?
How can you make a function that find the Factorial of a given number?
What does recursion mean?
How can we make factorial using recursion?
filter map reduce
how can you sort this list for even numbers using lambda?
nums = [3, 2, 6, 4, 3, 9, 11]
What are the two types of variables?
What is inheritance in python?
Class A:
Class B(A):
Class C(B):
but we can also say that C is inheriting from A and B (mom and dad) who are unrelated by…
Class A:
Class B:
Class C(A, B)
How do you handle exceptions?
use the
try:
except: #can use multiple excepts
except:
except:
finally:
setup….
Why is multi-threading important?
Say you have the list…
areas = [“hallway”, 11.25, “kitchen”, 18.0, “living room”, 20.0, “bedroom”, 10.75, “bathroom”, 9.50]
find the # Sum of kitchen and bedroom area and call it: eat_sleep_area
If.. areas = [“hallway”, 11.25, “kitchen”, 18.0, “living room”, 20.0, “bedroom”, 10.75, “bathroom”, 9.50]….. update the area of the bathroom area to be 10.50 square meters instead of 9.50.
AND Make the areas list more trendy! Change “living room” to “chill zone”
If.. areas = [“hallway”, 11.25, “kitchen”, 18.0, “living room”, 20.0, “bedroom”, 10.75, “bathroom”, 9.50]….. now You decide to build a poolhouse and a garage. Add this to the list..
What is wrong here?
The problem we have is that area_copy = areas is not explicit enough in copying the areas list. Thus, when we change the values of areas_copy[] to 5 we are in fact also changing the value [0] in the original areas list.
To avoid changing the original list when making changes in the copy, we must use either list(areas) or areas[:]
Say you have.
first = [11.25, 18.0, 20.0]
second = [10.75, 9.50]
now merge the two lists and write them in descending order…
In Numpy, Create numpy array np_height_in that is equal to first column of np_baseball.
- Print out the mean of np_height_in.
- Print out the median of np_height_in.
NOTE that the format is…. np.builtinfunction(nameofarray)
and… rememebr that NumPy has ROW first, column second so [:, 0]
In Numpy, # Print out correlation between first and second column. Replace ‘None’
corr = None
print(“Correlation: “ + str(corr))
Say you have two np.arays…
Heights of the goalkeepers: gk_heights
gk_heights = np_heights[np_positions == ‘GK’]
Heights of the other players: other_heights
other_heights = np_heights[np_positions != ‘GK’]
How can we get the median for each of them and print it?
How do you plot something on a logarithmic scale?
say you have plt.scatter(gdp_cap, life_exp)
plt. xscale(‘log’) #changing the x-axis to logarithmic
plt. show()
Say your x-axis is logarithmic and go from 1,000 to 100,000, how can we simplify the x-axis ticks?
tick_val = [1000, 10000, 100000]
tick_lab = [‘1k’, ‘10k’, ‘100k’]
plt. xticks(tick_val, tick_lab)
plt. show()
Explain this…
plt.scatter(x = gdp_cap, y = life_exp, s = np.array(pop) * 2, c = col, alpha = 0.8)
- We are making a scatter plot
- with gdp_cap on the x-axis
- and life_exp on the y-axis
- size is set to np.array(pop) * 2 #doubling the sizes of the bubbles
- c = col => colors are set acording to what has been defined in col which in this case is different colors depending on continent of origin
- alpha = 0.8 sets the opacity/transparency of the bubbles. 0 = 100 % opacity
How can we mark China and India on the plot?
We can add text with
plt. text(1550, 71, ‘India’)
plt. text(5700, 80, ‘China’)
we obviously need to know these values first.
When would you use list vs. dictionary?
List
- If you want to easily access values in an ordered matter (using indexes)
Dictionary
- When you want more freedom and have a unique table in which the unique keys can take different forms
Somebody thought it would be funny to mess with your accurately generated dictionary. An adapted version of the europe dictionary is available in the script on the right.
europe = {‘spain’:’madrid’, ‘france’:’paris’, ‘germany’:’bonn’,
‘norway’:’oslo’, ‘italy’:’rome’, ‘poland’:’warsaw’,
‘australia’:’vienna’ }
Can you clean up?
Dictionaries:
europe = { ‘spain’: { ‘capital’:’madrid’, ‘population’:46.77 },
‘france’: { ‘capital’:’paris’, ‘population’:66.03 },
‘germany’: { ‘capital’:’berlin’, ‘population’:80.62 },
‘norway’: { ‘capital’:’oslo’, ‘population’:5.084 } }
print out the capital of France:
- Create a dictionary, named data, with the keys ‘capital’ and ‘population’. Set them to ‘rome’ and 59.83, respectively.
- Add a new key-value pair to europe; the key is ‘italy’ and the value is data, the dictionary you just built.
Pandas: ‘Say you have a DataFrame ‘cars’, how can we change the index labels?
row_labels = [‘US’, ‘AUS’, ‘JPN’, ‘IN’, ‘RU’, ‘MOR’, ‘EG’]
cars.index = row_labels
Pandas, say you have a file, cars.csv, how can you import it as a DataFrame?
cars = pd.read.csv(‘cars.csv’) #remember ‘’ around the file name
print(cars)
Pandas.. Print out the drives_right value of the row corresponding to Morocco (its row label is MOR
If we have…
areas = [11.25, 18.0, 20.0, 10.75, 9.50]
How can we print the values one by one AND the index values?
use for loop + enumerate
If we have…
house = [[“hallway”, 11.25],
[“kitchen”, 18.0],
[“living room”, 20.0],
[“bedroom”, 10.75],
[“bathroom”, 9.50]]
Write a for loop that goes through each sublist of house and prints out the x is y sqm, where x is the name of the room and y is the area of the room.
If we have…
europe = {‘spain’:’madrid’, ‘france’:’paris’, ‘germany’:’berlin’,
‘norway’:’oslo’, ‘italy’:’rome’, ‘poland’:’warsaw’, ‘austria’:’vienna’ }
Write a for loop that goes through each key:value pair of europe. On each iteration, “the capital of x is y” should be printed out, where x is the key and y is the value of the pair.
We have…
import pandas as pd
cars = pd.read_csv(‘cars.csv’, index_col = 0)
and need to make the he first iteration print out “US: 809”, the second iteration “AUS: 731”, and so on.
“country: cars_per_cap”
(already set as “lab” and “row”)
In a DataFrame, how can you create a new column by calling a function on another column?
use .apply
very important feature.
.apply
random; How can you roll a dice?
How can you return multiple values from a function?
Using tuples!!
Explain this code:
How do you set a default parameter?
Here echo=1 => echo is set to 1 unless otherwise specified.
Thus, in line 13, we do not specify echo but it will return 1 time, while in line 15, we ask it to return 5 times
How would you write a lambda function add_bangsthat adds three exclamation points ‘!!!’ to the end of a string a? and How would you call add_bangs with the argument ‘hello’?
Convert this function to a lambda function
what is happening here?
If…
fellowship = [‘frodo’, ‘samwise’, ‘merry’, ‘pippin’, ‘aragorn’, ‘boromir’, ‘legolas’, ‘gimli’, ‘gandalf’]
Using lambda, create a new list that contains only strings that have more than 6 characters…
What are the ways to write in error messages?
try:
return:
except:
and…
if ‘something’:
raise _____Error(‘explanation’)
try:
return
except: _____Error
How can you select and print the retweets ‘RT’ from a Twitter DataFrame;
In this exercise, you are given a list of strings mutants and you will practice using enumerate() on it by printing out a list of tuples and unpacking the tuples using a forloop.
Now, create a list and unpack the tupls using a for loop:
Say we have mutants and powers, how do you create a zip object? AND then unpack it again?
Why may one want to load data in chunks and how is it done?’
Because there can be too much data to hold in memory.
pandas function: read_csv()
- specify the chunk with… chunksize
read_csv(‘filename’, chunksize=xxxx)
How can you iterate over the file tweets.csv in small portions and adding new words to a dictionary and counting the number of times each word is in that dictionary?
Say we have…
doctor = [‘house’, ‘cuddy’, ‘chase’, ‘thirteen’, ‘wilson’]
How would a list comprehension that produces a list of the first character of each string in doctor look like?
How can you add a condition to a list comprehension?
What are generators?
uses ()
Great for very big numbers as it does not store everything in memory (as a list comprehension would do).
While a list comprehension produces a list as output, a generator produces a generator object.
Create a generator object that will produce values from 0 to 30. Assign the result to result and print it using a for loop
What is the basic format of a list comprehension?
The lists2dict() function has already been preloaded, together with a couple of lists, feature_names and row_lists. feature_names contains the header names of the World Bank dataset and row_lists is a list of lists, where each sublist is a list of actual values of a row from the dataset.
Write a list comprehension to generate a list of values from pops_list for the new column ‘Total Urban Population’. The output expression should be the product of the first and second element in each tuple in pops_list. Because the 2nd element is a percentage, you also need to either multiply the result by 0.01or divide it by 100. In addition, note that the column ‘Total Urban Population’ should only be able to take on integer values. To ensure this, make sure you cast the output expression to an integer with int().
How do you read a file? (best practice)
How do you open a file using the “with”-method?
From the file, digits.csv, import the first 5 rows to a DataFrame, build a numpy array from this DataFrame and print the datatype
What are pickled files?
- A file type native to python
- Not readable by humans but readable by python/machines
- JSON files are an option if you want it readable by humans
- Motivation; many datatypes for which it isn’t obvious how to store (such as lists, dictionaries etc.)
- ‘rb’ means read only binary
How do you import Excel files to pandas?
figureo ut what the sheets in excel are called by
print(data.sheet_names) here as the file has been set to ‘data’
and to make dataframes of those sheets, use .parse and the sheet name OR sheet index
Import the file, battledeath.xlsx and display the sheet names
What is happening here?
How do you import a SAS file?
How do you import a Stata file?
What is a HDF5 file and how do you import it?
- Hierarchical Data format Version 5
- Standard for storing large quantities of numerical data.
- hundreds of gigabytes or terabytes (can scale to exabytes)
what is a MATLAB file and how do you import it?
- Matrix Laboratory
- Industry standard in engineering and science
scipy. io.loadmat() = read .mat files
scipy. io.savemat() = write .mat files
How can you create a database engine with SQLAlchemy?
How do you create an engine, connect to it, make a basic query, create a database and close it again?
- Import create_engine
- import pandas as pd
- Create the engine
- Connect to the engine
- Write a query (select * => imports all columns)
- Turn the query into a DataFrame using fetchall()
- Close the connection
How do you specify columns that you want to import AND specify the number of rows you want to import in a query + set the DataFrame’s column names to the corresponding names of the table columns?
How do you make a query that selects all “EmployeeID”s from “Employee” that is greater than or equal to 6?
How can this be done much smarter with Pandas?
How do you import data from a url?
It is possible to skip the step of saving it locally (line 8-9) and just plug in the url directly in pd.read_csv so:
df = pd.read_csv(url, sep=’;’)
How do you send a GET request to a certain URL and afterwards read the response? (http.client.HTTPResponse)
How do you make HTTP requests for an URL using the requests package?
What is the BeautifulSoup package for?
- Parse and extract structured data from HTML
- “Make tag soup beautiful and extract information”
use the BeautifulSoup package to parse, prettify and extract information from HTML.
The URL of interest is url = ‘https://www.python.org/~guido/’.
Load the JSON ‘a_movie.json’ into the variable json_data, which will be a dictionary. Next, explore the JSON contents by printing the key-value pairs of json_data to the shell.
How do you connect to an API?
Import and print the text from the URL, http://www.omdbapi.com/ with the these two argument in the query string; apikey=72bc447a and t=the+social+network
What are the 3 principles of tidy data?
- Columns represent separate variables
- Rows represent individual observations
- Observational units form tables
Tidy data makes it easier to fix common data problems
What is this doing?
- We are melting columns except ‘month’ and ‘day’
- we call the value-column = reading
- and the variable column = measurement
Melting turns columns into rows
What is this doing?
Pivoting such that
- we do not change the two columns ‘month’ and ‘day’
- we change the ‘measurement’ column and split the unique values in this column into new columns
- and take the values from ‘reading’ and plug them into those rows
How would you split a column containing gender and age values in one such as m014, m65, f65, f4554 and so forth?
How would you split a column with values such as Cases_Guinea, Deaths_Guinea, Cases_Liberia, Deaths_Liberia?
_ serves as a delimiter
we can use .split()
How do you convert an object column to categorical?
This will lower the memory need
How do you convert a column to numeric?
How can you make the computer interpret $17.00 with escape sequences?
How can you make the computer interpret $17.89 with escape sequences? #make sure it only takes two decimals for the monetary value
How do make a pattern matching for a us phone number in the format xxx-xxx-xxxx?
How can you make python extract the numbers found in a string? ‘the recipe calls for 10 strawberries and 1 banana’
How could you write a pattern matching sequence to make ‘$123.45’ turn True?
How do you make an assert statement?
What is this doing?
- We have a dataset, ‘gapminder’ with 780 rows and 218 columns
- each column represent a year with life expectancy data
- but the very first column [0] has the country names
- we then melt the data such together such that we get rows instead of columns = one row will have a year value, the life expectancy and the associated country
- we make sure not to touch the country life by putting ‘life expectancy’ in as id_vars
- we then rename the columns to ‘country’, ‘year’ and ‘life_expectancy’
- and print the head of it
How do you convert the column ‘year’ in the df ‘gapminder’ to numeric AND asset that the change has been made?
Say you have two lists, ‘list_keys’ and ‘list_values’, how do you create a dictionary and then a dataframe?
How can you in a structured way rename the columns of your dataframe?
Say we have a list of cities in Pennsylvania, how can we create a dataframe from this list AND add a column with the value ‘PA’ for Pennsylvania in all rows?
How can you downsample hourly data of ‘Temperature’ in df to six hours and to daily?
Say we have a df with the column ‘Temperature’ and we want to extract all of august 2010 and show the maximum daily temperature?
Say we have the dataframe, ‘sales’ and want to make both the ‘state’ and the ‘month’ column indexes, what will we have to do?
Set the index to be the columns [‘state’, ‘month’]: sales
sales = sales.set_index([‘state’, ‘month’])
Sort the MultiIndex: sales
sales = sales.sort_index()
Print the sales DataFrame
print(sales)
How can you switch around indexes in a multi-index?
swapped = df.swaplevel(0, 1)
swapped.sort_index()
what type of plot do you get from usa_medals_by_year.plot.area()?
what is rug=True doing? sns.distplot(eu_metro_areas[“GDP”],bins=7,rug=True)
it will show small bars for each observation/datapoint in the graph so we understand how big the dataset is
