pandas
Bestanden lezen in Panda's DataFrame

Tabel in DataFrame lezen

Tabelbestand met kop-, voettekst, rijnamen en indexkolom:

bestand: table.txt

This is a header that discusses the table file
to show space in a generic table file

index  name     occupation
1      Alice    Salesman
2      Bob      Engineer
3      Charlie  Janitor  

This is a footer because your boss does not understand data files

code:

import pandas as pd
# index_col=0 tells pandas that column 0 is the index and not data 
pd.read_table('table.txt', delim_whitespace=True, skiprows=3, skipfooter=2, index_col=0)

output:

          name occupation
index
1        Alice   Salesman
2          Bob   Engineer
3      Charlie    Janitor

Tabelbestand zonder rijnamen of index:

bestand: table.txt

Alice    Salesman
Bob      Engineer
Charlie  Janitor 

code:

import pandas as pd 
pd.read_table('table.txt', delim_whitespace=True, names=['name','occupation'])

output:

      name occupation
0    Alice   Salesman
1      Bob   Engineer
2  Charlie    Janitor

Alle opties zijn te vinden in de pandas-documentatie hier

Lees CSV-bestand

Gegevens met koptekst, gescheiden door puntkomma's in plaats van komma's

bestand: table.csv

index;name;occupation
1;Alice;Saleswoman
2;Bob;Engineer
3;Charlie;Janitor

code:

import pandas as pd
pd.read_csv('table.csv', sep=';', index_col=0)

output :

          name occupation
index
1        Alice   Salesman
2          Bob   Engineer
3      Charlie    Janitor

Tabel zonder rijnamen of index en komma's als scheidingstekens

bestand: table.csv

Alice,Saleswoman
Bob,Engineer
Charlie,Janitor

code:

import pandas as pd 
pd.read_csv('table.csv', names=['name','occupation'])

output:

      name occupation
0    Alice   Salesman
1      Bob   Engineer
2  Charlie    Janitor

verdere verduidelijking is te vinden op de documentatiepagina van read_csv

Verzamel Google-spreadsheetgegevens in Panda's-dataframe

Soms moeten we gegevens verzamelen van Google-spreadsheets. We kunnen gspread- en oauth2client- bibliotheken gebruiken om gegevens van Google-spreadsheets te verzamelen. Hier is een voorbeeld om gegevens te verzamelen:

Code:

from __future__ import print_function
import gspread
from oauth2client.client import SignedJwtAssertionCredentials
import pandas as pd
import json

scope = ['https://spreadsheets.google.com/feeds']

credentials = ServiceAccountCredentials.from_json_keyfile_name('your-authorization-file.json', scope)

gc = gspread.authorize(credentials)

work_sheet = gc.open_by_key("spreadsheet-key-here")
sheet = work_sheet.sheet1
data = pd.DataFrame(sheet.get_all_records()) 

print(data.head())