Dataset research report
Codeparrot Clean research report
A reproducible data report with schema notes, generated chart evidence, suggested follow-up questions, and export-ready Helix queries.
Executive Summary
CodeParrot 🦜 Dataset Cleaned What is it? A dataset of Python files from Github. This is the deduplicated version of the codeparrot. Processing The original dataset contains a lot of duplicated and noisy data. Therefore, the dataset was cleaned with the following steps: Deduplication Remove exact matches Filtering Average line length < 100 Maximum line length < 1000 Alpha numeric characters fraction > 0.25 Remove auto-generated files (keyword search) For… See the full description on the dataset page: https://huggingface.co/datasets/codeparrot/codeparrot-clean.
Research Context
Codeparrot Clean: 500 rows by 11 columns. These exploratory charts are generated automatically from the data - open the dataset in Helix to ask your own questions.
Data Profile
Chart Evidence
These views are generated from the dataset profile. Each chart is paired with a Helix query so it can be opened, adjusted, and exported.
Total line_mean by license
Top license values ranked by summed line_mean.
Open and export this chartline_mean vs line_max
Relationship between line_mean and line_max.
Open and export this chartCorrelation of numeric columns
Pearson correlation between numeric columns.
Open and export this chartFollow-Up Queries
Preview Rows
| # | repo_nametext | pathtext | copiestext | sizetext | contenttext | licensetext | hashinteger | line_meanfloat |
|---|---|---|---|---|---|---|---|---|
| 1 | ahmedbodi/AutobahnPython | examples/asyncio/websocket/echo/client_coroutines.py | 13 | 2044 | ############################################################################### ## ## Copyright (C) 2013-2014 Tavendo GmbH ## ## Licensed… | apache-2.0 | 7822061744094950801 | 31.44 |
| 2 | ifduyue/django | django/core/checks/registry.py | 13 | 3108 | from itertools import chain from django.utils.itercompat import is_iterable class Tags: """ Built-in tags for internal checks. … | bsd-3-clause | -2035686896372967697 | 30.71 |
| 3 | kmike/scikit-learn | sklearn/utils/__init__.py | 3 | 10094 | """ The :mod:`sklearn.utils` module includes various utilites. """ from collections import Sequence import numpy as np from scipy.sparse … | bsd-3-clause | 2334709577611160651 | 26.88 |
| 4 | houlixin/BBB-TISDK | linux-devkit/sysroots/i686-arago-linux/usr/lib/python2.7/encodings/cp1250.py | 593 | 13942 | """ Python Character Mapping Codec cp1250 generated from 'MAPPINGS/VENDORS/MICSFT/WINDOWS/CP1250.TXT' with gencodec.py. """#" import code… | gpl-2.0 | -6356832018515182181 | 44.41 |
| 5 | dataxu/ansible | lib/ansible/modules/system/kernel_blacklist.py | 125 | 4009 | #!/usr/bin/python # encoding: utf-8 -*- # Copyright: (c) 2013, Matthias Vogelgesang <[email protected]> # GNU General Public … | gpl-3.0 | 8498771084445726761 | 24.86 |
| 6 | 163gal/Time-Line | libs_arm/wx/_controls.py | 2 | 332374 | # This file was created automatically by SWIG 1.3.29. # Don't modify this file, modify the SWIG interface instead. import _controls_ impor… | gpl-3.0 | -3839353247363315950 | 41.47 |
Data Dictionary
- repo_name text
- path text
- copies text
- size text
- content text
- license categorical
- hash numeric
- line_mean numeric
- line_max numeric
- alpha_frac numeric
- autogenerated bool
Method And Limits
- Load the catalog entry and preview rows from the processed dataset file.
- Infer numeric, categorical, time, and location fields from real columns.
- Generate a small set of defensive Plotly chart specifications from that profile.
- Expose each chart idea as a query link so the report can be rerun or exported in Helix.
This report is intentionally reproducible. It uses the local catalog metadata and generated chart specifications rather than claiming external conclusions beyond the dataset.