Car Sales Data Engineering Analytics

reason-machines/data-skills/skills/car-sales-data-engineering-analytics

作者 reason-machines8e7bd5f22574无许可证4 个星标收录于 2026年10月8日更新于 2026年10月8日仓库2个月前更新

Process, clean, and analyze car sales data with statistical modeling and interactive Streamlit dashboards for business insights.

仅含说明Data & Analytics
AI 生成的概览

处理、清洗并统计分析汽车销售数据，生成图表和交互式 Streamlit 仪表板。

功能
该技能描述了一套面向约 2.4 万条汽车销售记录的 ETL 与分析框架。内容包括加载和清洗 CSV、计算描述性统计与收入指标、运行 15 项预设分析（如价格分布、地区与月度趋势、t 检验、多元线性回归、Z 分数异常值检测和 Shapiro-Wilk 正态性检验），并保存清洗后的数据和 PNG 图表。它还说明了具备筛选、分组对比和 CSV 导出功能的 Streamlit 仪表板。
适用场景
适用于处理汽车销售数据集并需要清洗、统计建模或面向业务的可视化时。适合价格、地区、人口统计或产品结构分析，以及构建交互式销售仪表板的需求。
运行要求
需要 Python 3.10+ 及 pandas、numpy、matplotlib、scipy 和 streamlit，使用 uv 管理。需要汽车销售 CSV 文件，并会输出清洗数据和图表。该技能仅包含说明，不附带脚本。

Car Sales Data Engineering & Analytics

Skill by ara.so — Data Skills collection.

A comprehensive data engineering and analytics framework for processing ~24K car sales records with ETL pipelines, statistical modeling, and interactive Streamlit dashboards. Provides 15 pre-built analyses covering pricing trends, regional patterns, demographic insights, and feature correlations.

Installation

This project uses uv for package management:

bash
# Clone the repositorygit clone https://github.com/Abdumalik-ProDev/Car-Sales-Data-Engineering.gitcd Car-Sales-Data-Engineering
# Install dependenciesuv sync

Dependencies: Python 3.10+, pandas, numpy, matplotlib, scipy, streamlit

Quick Start

Launch Interactive Dashboard

bash
# Start Streamlit web UIuv run streamlit run src/ui.py
# Alternative via entry pointuv run python -m src.main

Run Full Pipeline

bash
# Execute all 15 analyses and generate figuresuv run python -m src.main --pipeline

This will:

  • Load and clean data/Car sales.csv
  • Generate outputs/cleaned_data.csv
  • Create 15 PNG charts in outputs/figures/

Core Module: src/analysis.py

The main analysis engine provides ETL, statistics, and modeling capabilities.

Data Loading & Cleaning

python
from src.analysis import CarSalesAnalysis
# Initialize analyzeranalyzer = CarSalesAnalysis('data/Car sales.csv')
# Access cleaned datadf = analyzer.dataprint(f"Total records: {len(df)}")print(f"Columns: {df.columns.tolist()}")
# Save cleaned datasetanalyzer.save_cleaned_data('outputs/cleaned_data.csv')

Key Columns:

  • car_id, date, customer_name, dealer_name, company, model
  • year, price, body_style, transmission, color
  • dealer_no, dealer_region, phone, gender, annual_income

Statistical Summaries

python
# Get descriptive statisticsstats = analyzer.describe_data()print(stats)
# Revenue metricstotal_revenue = analyzer.data['price'].sum()avg_price = analyzer.data['price'].mean()median_price = analyzer.data['price'].median()
print(f"Total Revenue: ${total_revenue:,.0f}")print(f"Avg Price: ${avg_price:,.0f}")print(f"Median Price: ${median_price:,.0f}")

Generate Individual Analyses

python
# Q1: Price distributionanalyzer.plot_price_distribution(save_path='outputs/figures/q1_price_dist.png')
# Q2: Monthly sales trendanalyzer.plot_monthly_sales_trend(save_path='outputs/figures/q2_monthly_trend.png')
# Q3: Sales by regionanalyzer.plot_sales_by_region(save_path='outputs/figures/q3_regional_sales.png')
# Q6: Income vs Price regressionanalyzer.plot_income_vs_price(save_path='outputs/figures/q6_income_price.png')
# Q9: Automatic vs Manual transmission comparison (t-test)analyzer.compare_transmission_prices(save_path='outputs/figures/q9_transmission.png')

Statistical Modeling

python
# Q12: Multiple linear regression# Predicts price from year, annual_income, transmissionanalyzer.multiple_regression_analysis(save_path='outputs/figures/q12_regression.png')
# Q13: Detect outliers using Z-scoresanalyzer.detect_outliers_zscore(save_path='outputs/figures/q13_outliers.png')
# Q15: Test price normality with Shapiro-Wilkanalyzer.test_normality(save_path='outputs/figures/q15_normality.png')

Streamlit Dashboard (src/ui.py)

Page Structure

The dashboard provides 6 interactive sections:

  1. 📊 Overview - Data summary, sample rows, statistics
  2. 💰 Sales & Revenue - Price trends, regional analysis
  3. 👥 Demographics - Gender, income patterns
  4. 🔧 Product Insights - Brand, body style, transmission
  5. 📈 Statistical Modeling - Regression, outliers, normality
  6. 🔍 Filter & Explore - Custom filters with CSV export
  7. ⚖️ Compare Segments - Side-by-side comparison with t-tests

Custom Filtering Example

python
# Users can filter via sidebar widgets# Example: Filter cars by price range and region
# In ui.py, the filter logic:filtered = analyzer.data.copy()
if price_range:    filtered = filtered[        (filtered['price'] >= price_range[0]) &         (filtered['price'] <= price_range[1])    ]
if selected_regions:    filtered = filtered[filtered['dealer_region'].isin(selected_regions)]
if selected_companies:    filtered = filtered[filtered['company'].isin(selected_companies)]
# Display and exportst.dataframe(filtered)st.download_button(    "Download CSV",    filtered.to_csv(index=False),    "filtered_sales.csv")

Common Analysis Patterns

Price Analysis by Category

python
# Average price by car companycompany_prices = analyzer.data.groupby('company')['price'].mean().sort_values(ascending=False)print(company_prices.head(10))
# Price by body stylebody_prices = analyzer.data.groupby('body_style')['price'].agg(['mean', 'median', 'count'])print(body_prices)
# Price by transmission typetrans_prices = analyzer.data.groupby('transmission')['price'].describe()print(trans_prices)

Regional & Temporal Analysis

python
# Sales volume by regionregional_sales = analyzer.data['dealer_region'].value_counts()print(regional_sales)
# Monthly revenue trendanalyzer.data['month'] = pd.to_datetime(analyzer.data['date']).dt.to_period('M')monthly_revenue = analyzer.data.groupby('month')['price'].sum()print(monthly_revenue)
# Year-over-year comparisonyearly_sales = analyzer.data.groupby('year').agg({    'price': ['sum', 'mean', 'count']})print(yearly_sales)

Statistical Tests

python
from scipy import stats
# Compare prices: Automatic vs Manual transmissionauto_prices = analyzer.data[analyzer.data['transmission'] == 'Automatic']['price']manual_prices = analyzer.data[analyzer.data['transmission'] == 'Manual']['price']
t_stat, p_value = stats.ttest_ind(auto_prices, manual_prices)print(f"T-statistic: {t_stat:.4f}, P-value: {p_value:.4f}")
# Correlation between income and pricecorrelation = analyzer.data['annual_income'].corr(analyzer.data['price'])print(f"Income-Price Correlation: {correlation:.4f}")

Configuration

File Paths

Default paths are defined in src/analysis.py:

python
# Customize data pathsanalyzer = CarSalesAnalysis('custom_path/sales_data.csv')
# Custom output directoryanalyzer.save_cleaned_data('custom_output/cleaned.csv')
# Figures directoryos.makedirs('custom_figures', exist_ok=True)analyzer.plot_price_distribution(save_path='custom_figures/prices.png')

Streamlit Configuration

Create .streamlit/config.toml for dashboard customization:

toml
[theme]primaryColor = "#FF4B4B"backgroundColor = "#FFFFFF"secondaryBackgroundColor = "#F0F2F6"textColor = "#262730"
[server]port = 8501headless = trueenableCORS = false

Running Full Pipeline Programmatically

python
from src.analysis import CarSalesAnalysisimport os
# Initializeanalyzer = CarSalesAnalysis('data/Car sales.csv')
# Create output directoriesos.makedirs('outputs/figures', exist_ok=True)
# Save cleaned dataanalyzer.save_cleaned_data('outputs/cleaned_data.csv')
# Generate all 15 analysesanalyses = [    ('q1_price_dist.png', analyzer.plot_price_distribution),    ('q2_monthly_trend.png', analyzer.plot_monthly_sales_trend),    ('q3_regional_sales.png', analyzer.plot_sales_by_region),    ('q4_gender_split.png', analyzer.plot_gender_distribution),    ('q5_income_region.png', analyzer.plot_income_by_region),    ('q6_income_price.png', analyzer.plot_income_vs_price),    ('q7_company_prices.png', analyzer.plot_avg_price_by_company),    ('q8_body_style.png', analyzer.plot_price_by_body_style),    ('q9_transmission.png', analyzer.compare_transmission_prices),    ('q10_colors.png', analyzer.plot_popular_colors),    ('q11_heatmap.png', analyzer.plot_body_transmission_heatmap),    ('q12_regression.png', analyzer.multiple_regression_analysis),    ('q13_outliers.png', analyzer.detect_outliers_zscore),    ('q14_dealer_prices.png', analyzer.plot_dealer_prices),    ('q15_normality.png', analyzer.test_normality),]
for filename, func in analyses:    func(save_path=f'outputs/figures/{filename}')    print(f"✓ Generated {filename}")

Troubleshooting

Missing Data Issues

python
# Check for missing valuesmissing = analyzer.data.isnull().sum()print(missing[missing > 0])
# Handle missing valuesanalyzer.data = analyzer.data.dropna(subset=['price', 'year'])analyzer.data['annual_income'].fillna(analyzer.data['annual_income'].median(), inplace=True)

Date Parsing Errors

python
# Ensure proper date formatanalyzer.data['date'] = pd.to_datetime(analyzer.data['date'], errors='coerce')analyzer.data = analyzer.data.dropna(subset=['date'])

Memory Issues with Large Datasets

python
# Load only required columnsusecols = ['price', 'company', 'body_style', 'dealer_region', 'year']df = pd.read_csv('data/Car sales.csv', usecols=usecols)
# Use dtype optimizationdf['price'] = df['price'].astype('float32')df['year'] = df['year'].astype('int16')

Streamlit Port Conflicts

bash
# Specify custom portuv run streamlit run src/ui.py --server.port 8502
# Or in configecho "[server]\nport = 8502" > .streamlit/config.toml

Key Insights Reference

  • Total Records: 23,906 sales
  • Revenue: $655.6M total
  • Pricing: $27,426 avg, $23,000 median
  • Top Body Style: SUV (27%)
  • Top Region: Austin (17%)
  • Premium Brand: Cadillac ($37,557 avg)
  • Demographics: 79% Male, 21% Female
  • Transmission: 53% Automatic, 47% Manual

来源与署名

来源：reason-machines/data-skills位于skills/car-sales-data-engineering-analytics提交8e7bd5f

许可证： 无许可证

内容归原作者所有。SourceWeft 从公开仓库中收录这些内容。

举报或申请下架

更多来自 reason-machines/data-skills 的技能

Youtube Channel Analytics Dashboard

reason-machines

介绍一款用于跟踪 YouTube 频道观看量、订阅者、收入和受众数据的 Windows 仪表板工具。

Data & Analytics42个月前更新

Terraform Iac Data Engineering

reason-machines

提供用于在 AWS 上预置 S3、EC2 和 IAM 等数据工程资源的 Terraform 基础设施即代码模式。

DevOps & Cloud42个月前更新

Terraform Data Engineering Infrastructure

reason-machines

使用 Terraform 为数据工程配置 AWS 基础设施（S3、EC2、IAM）的模式与命令。

DevOps & Cloud42个月前更新

Retail Etl Pipeline Medallion

reason-machines

指导使用 SQL Server 和可选 PySpark 构建包含青铜、白银、黄金三层的零售 ETL 数据仓库。

Data & Analytics42个月前更新

Power Bi Salespulse 360 Dashboard

reason-machines

指导构建 SalesPulse 360 Power BI 零售仪表板，用于销售、利润、预测和预警分析。

Data & Analytics42个月前更新

Logifleet Pulse Supply Chain Analytics

reason-machines

在 MS SQL Server 上构建物流数据仓库，并用 Power BI 仪表板分析仓储与车队数据。

Data & Analytics42个月前更新

更多Data & Analytics技能

Swap Curve Strategy

anthropics

精选

利用 MCP 定价工具分析利率互换曲线、互换利差、实际利率与曲线交易机会。

Data & Analytics39K2周前更新

Unit Economics

anthropics

精选

为私募股权标的分析单位经济：ARR 队列、LTV/CAC、净留存、回收期与利润瀑布。

Data & Analytics39K2周前更新

Option Vol Analysis

anthropics

精选

通过结合波动率曲面、含希腊字母的期权定价与历史价格，比较隐含波动率与已实现波动率。

Data & Analytics39K2周前更新

Macro Rates Monitor

anthropics

精选

利用 MCP 的 GDP、通胀、收益率曲线、盈亏平衡通胀和互换数据，构建宏观与利率仪表板。

Data & Analytics39K2周前更新

Clean Data Xls

anthropics

精选

清理杂乱表格数据：去除空白、统一大小写、转换文本数字、规范日期并删除重复项。

Data & Analytics39K2周前更新

Fixed Income Portfolio

anthropics

精选

通过债券定价、汇总风险指标、预测现金流并运行利率情景，审查固定收益投资组合。

Data & Analytics39K2周前更新