Junior — Middle
How do you handle and extract data from sources?
sobes.tech AI
Answer from AI
Processing and extracting data from sources in Python typically involves the following steps:
- Connecting to the data source (file, database, API).
- Reading data using appropriate libraries (e.g.,
pandasfor CSV/Excel,requestsfor API,sqlite3orSQLAlchemyfor databases). - Cleaning and transforming data (removing missing values, converting types).
- Extracting necessary information or aggregating.
Example of reading a CSV and extracting a column using pandas:
import pandas as pd
data = pd.read_csv('data.csv')
filtered_data = data[data['age'] > 30] # filtering by condition
print(filtered_data[['name', 'age']])
For working with APIs, you can use requests:
import requests
response = requests.get('https://api.example.com/data')
if response.status_code == 200:
json_data = response.json()
# process json_data