Sobes.tech
Junior — Middle

How do you handle and extract data from sources?

sobes.tech AI

Answer from AI

Processing and extracting data from sources in Python typically involves the following steps:

  1. Connecting to the data source (file, database, API).
  2. Reading data using appropriate libraries (e.g., pandas for CSV/Excel, requests for API, sqlite3 or SQLAlchemy for databases).
  3. Cleaning and transforming data (removing missing values, converting types).
  4. Extracting necessary information or aggregating.

Example of reading a CSV and extracting a column using pandas:

import pandas as pd

data = pd.read_csv('data.csv')
filtered_data = data[data['age'] > 30]  # filtering by condition
print(filtered_data[['name', 'age']])

For working with APIs, you can use requests:

import requests

response = requests.get('https://api.example.com/data')
if response.status_code == 200:
    json_data = response.json()
    # process json_data