Swe Gym
Hugging FaceSWE-Gym contains 2438 instances sourced from 11 Python repos, following SWE-Bench data collection procedure. Get started at project page github.com/SWE-Gym/SWE-Gym
Ask a question about this data
Type any question in plain English — Helix builds the chart with AI. Sign in to run it and save your charts.
Data preview
500 rows · 11 columns · showing first 12| # | instance_id text | hints_text text | patch text | test_patch text | created_at text | problem_statement text | repo text | base_commit text | version text | PASS_TO_PASS text | FAIL_TO_PASS text |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | getmoto__moto-7365 | diff --git a/moto/dynamodb/models/dynamo_type.py b/moto/dynamodb/models/dynamo_type.py --- a/moto/dynamodb/models/dynamo_type.py +++ b/moto… | diff --git a/tests/test_dynamodb/test_dynamodb_update_expressions.py b/tests/test_dynamodb/test_dynamodb_update_expressions.py --- a/tests/… | 2024-02-19 20:29:03 | DynamoDB's `update_item` performs floating-point arithmetic with mock table created via `boto3` When using `moto.mock_aws` to create a `pyt… | getmoto/moto | 7f6c9cb1deafb280fe7fcc7551c38e397f11a706 | 5.0 | ['tests/test_dynamodb/test_dynamodb_update_expressions.py::test_update_different_map_elements_in_single_request'] | ['tests/test_dynamodb/test_dynamodb_update_expressions.py::test_update_item_add_float'] | |
| 2 | getmoto__moto-6920 | Hi @MacHu-GWU, that attribute should be calculated inside the `LayerVersion`-class: https://github.com/getmoto/moto/blob/368fa07ec35aa6806… | diff --git a/moto/awslambda/models.py b/moto/awslambda/models.py --- a/moto/awslambda/models.py +++ b/moto/awslambda/models.py @@ -371,6 +3… | diff --git a/tests/test_awslambda/test_lambda_layers.py b/tests/test_awslambda/test_lambda_layers.py --- a/tests/test_awslambda/test_lambda… | 2023-10-15 20:33:23 | Lambda publish_layer_version function failed due to the wrong implementation ## Reporting Bugs When you run ``publish_layer_version`` … | getmoto/moto | 2021e564fafcdaa701b53de49bd580c8691a5fcc | 4.2 | ['tests/test_awslambda/test_lambda_layers.py::test_get_layer_version__unknown' 'tests/test_awslambda/test_lambda_layers.py::test_publish_l… | ['tests/test_awslambda/test_lambda_layers.py::test_publish_layer_with_unknown_s3_file'] |
| 3 | getmoto__moto-5876 | All good @JorisLimousin - every enhancement is useful! hi, I am interested in fixing this issue. it will be a great opportunity to fix this… | diff --git a/moto/cognitoidp/exceptions.py b/moto/cognitoidp/exceptions.py --- a/moto/cognitoidp/exceptions.py +++ b/moto/cognitoidp/except… | diff --git a/tests/test_cognitoidp/test_cognitoidp_exceptions.py b/tests/test_cognitoidp/test_cognitoidp_exceptions.py --- a/tests/test_cog… | 2023-01-24 23:37:57 | Cognito - No validation that there isn't already an existing user with the same username in admin_update_user_attributes Hi, Sorry for t… | getmoto/moto | 6d41ad72e09b49f61e54d47880f8a65026e7c0e4 | 4.1 | ['tests/test_cognitoidp/test_cognitoidp_exceptions.py::TestCognitoUserPoolDuplidateEmails::test_use_existing_email__when_username_is_login'… | ['tests/test_cognitoidp/test_cognitoidp_exceptions.py::TestCognitoUserPoolDuplidateEmails::test_use_existing_email__when_email_is_login'] |
| 4 | getmoto__moto-5085 | Hi @dkatzbuc, thanks for raising this - doesn't look like this behaviour is implemented yet. Marking it as an enhancement. | diff --git a/moto/core/responses.py b/moto/core/responses.py --- a/moto/core/responses.py +++ b/moto/core/responses.py @@ -725,20 +725,6 @@… | diff --git a/tests/test_ec2/test_instances.py b/tests/test_ec2/test_instances.py --- a/tests/test_ec2/test_instances.py +++ b/tests/test_ec… | 2022-05-01 18:07:16 | When creating ec2 instances from launch template via run_instances, the instances aren't tagged I'm using moto in pytest. I have created a … | getmoto/moto | 6b70cd1b6b1cf493b66b6fcaaea9d1041331e836 | 3.1 | ['tests/test_ec2/test_instances.py::test_run_instance_with_block_device_mappings_missing_ebs' 'tests/test_ec2/test_instances.py::test_get_… | ['tests/test_ec2/test_instances.py::test_create_instance_from_launch_template__process_tags'] |
| 5 | getmoto__moto-6709 | The Dynamo item has `software`, but the query looks for `packages` - could that be the problem? Note that I haven't verified this in Mot… | diff --git a/moto/dynamodb/models/__init__.py b/moto/dynamodb/models/__init__.py --- a/moto/dynamodb/models/__init__.py +++ b/moto/dynamodb… | diff --git a/tests/test_dynamodb/models/test_item.py b/tests/test_dynamodb/models/test_item.py --- a/tests/test_dynamodb/models/test_item.p… | 2023-08-21 18:57:36 | DynamoDB: special characters in get_item() projection expression not handled correctly Hi! I have a nested attribute inside a dynamodb t… | getmoto/moto | 78c518ddc832a30e1cf20015bc5c3b1850a1c797 | 4.1 | ['tests/test_dynamodb/test_dynamodb.py::test_remove_list_index__remove_existing_nested_index' 'tests/test_dynamodb/test_dynamodb.py::test_… | ['tests/test_dynamodb/models/test_item.py::TestFindNestedKeys::test_project_single_key_dict' 'tests/test_dynamodb/models/test_item.py::Tes… |
| 6 | getmoto__moto-7082 | diff --git a/moto/logs/exceptions.py b/moto/logs/exceptions.py --- a/moto/logs/exceptions.py +++ b/moto/logs/exceptions.py @@ -11,7 +11,8 @… | diff --git a/tests/test_logs/test_export_tasks.py b/tests/test_logs/test_export_tasks.py new file mode 100644 --- /dev/null +++ b/tests/tes… | 2023-11-30 22:25:53 | Logs: create_export_task() currently does not export any data to S3 Two reasons: - the `filter_log_events` does not check any streams (a… | getmoto/moto | 8a16a6a86286983ea0c60591edbee729219b729f | 4.2 | ['tests/test_logs/test_logs.py::test_create_log_group[arn:aws:kms:us-east-1:000000000000:key/51d81fab-b138-4bd2-8a09-07fd6d37224d]' 'tests… | ['tests/test_logs/test_export_tasks.py::test_create_export_executes_export_task' 'tests/test_logs/test_logs_query/test_boto3.py::test_star… | |
| 7 | getmoto__moto-5212 | diff --git a/moto/ec2/exceptions.py b/moto/ec2/exceptions.py --- a/moto/ec2/exceptions.py +++ b/moto/ec2/exceptions.py @@ -28,6 +28,14 @@ d… | diff --git a/tests/test_ec2/test_vpcs.py b/tests/test_ec2/test_vpcs.py --- a/tests/test_ec2/test_vpcs.py +++ b/tests/test_ec2/test_vpcs.py … | 2022-06-10 09:47:08 | create_vpc should never create a default vpc The create_vpc call never creates a default VPC in AWS - there is a separate create_default_v… | getmoto/moto | a2c2c06243b49207797ab0798dbfa8c1f6cb6477 | 3.1 | ['tests/test_ec2/test_vpcs.py::test_create_vpc_with_invalid_cidr_block_parameter' 'tests/test_ec2/test_vpcs.py::test_vpc_dedicated_tenancy… | ['tests/test_ec2/test_vpcs.py::test_creating_a_vpc_in_empty_region_does_not_make_this_vpc_the_default' 'tests/test_ec2/test_vpcs.py::test_… | |
| 8 | getmoto__moto-5386 | Hi @ericrafalovsky, is the option to mock the `hibernation_options`-argument in `run_instances` enough for your use-case? Or is there addit… | diff --git a/moto/ec2/models/instances.py b/moto/ec2/models/instances.py --- a/moto/ec2/models/instances.py +++ b/moto/ec2/models/instances… | diff --git a/tests/test_ec2/test_instances.py b/tests/test_ec2/test_instances.py --- a/tests/test_ec2/test_instances.py +++ b/tests/test_ec… | 2022-08-14 11:51:34 | EC2: Add support for hibernation APIs Currently, the EC2 model does not support the APIs necessary for [instance hibernation](https://docs.… | getmoto/moto | 3d913f8f1568e4232ffaab06e261b88bb1142a75 | 4.0 | ['tests/test_ec2/test_instances.py::test_run_instance_with_block_device_mappings_missing_ebs' 'tests/test_ec2/test_instances.py::test_get_… | ['tests/test_ec2/test_instances.py::test_run_instance_with_additional_args[False]' 'tests/test_ec2/test_instances.py::test_run_instance_wi… |
| 9 | getmoto__moto-4950 | Thanks for raising this @jhogarth - marking it as an enhancement. | diff --git a/moto/timestreamwrite/responses.py b/moto/timestreamwrite/responses.py --- a/moto/timestreamwrite/responses.py +++ b/moto/times… | diff --git a/tests/test_timestreamwrite/test_timestreamwrite_table.py b/tests/test_timestreamwrite/test_timestreamwrite_table.py --- a/test… | 2022-03-19 02:53:34 | Timestream Write has the wrong response returned ### Environment Python 3.10.2 (and 3.9 in lambda) Libraries involved installed from pi… | getmoto/moto | 0fcf6529ab549faf7a2555d209ce2418391b7f9f | 3.1 | ['tests/test_timestreamwrite/test_timestreamwrite_table.py::test_update_table' 'tests/test_timestreamwrite/test_timestreamwrite_table.py::… | ['tests/test_timestreamwrite/test_timestreamwrite_table.py::test_write_records'] |
| 10 | getmoto__moto-7456 | Hi @StevenCaswellVR, I'll mark it as an enhancement. Is it just the one method that you need? Actually there are several methods I need:… | diff --git a/moto/backend_index.py b/moto/backend_index.py --- a/moto/backend_index.py +++ b/moto/backend_index.py @@ -131,6 +131,7 @@ … | diff --git a/tests/test_resiliencehub/__init__.py b/tests/test_resiliencehub/__init__.py new file mode 100644 diff --git a/tests/test_resil… | 2024-03-10 22:57:44 | Please add support for the ResilienceHub API I am using moto 5.0.2, Python mocks with Python 3.11.3, boto3 1.26.68, botocore 1.29.165. I… | getmoto/moto | bfe1c12823a49c351c485aa87cff0b22ca7e6489 | 5.0 | [] | ['tests/test_resiliencehub/test_resiliencehub.py::test_describe_unknown_app' 'tests/test_resiliencehub/test_resiliencehub.py::test_create_… |
| 11 | getmoto__moto-5725 | Thanks for raising this @1oglop1 - will mark it as an enhancement to implement this validation. | diff --git a/moto/route53/exceptions.py b/moto/route53/exceptions.py --- a/moto/route53/exceptions.py +++ b/moto/route53/exceptions.py @@ -… | diff --git a/tests/test_route53/test_route53.py b/tests/test_route53/test_route53.py --- a/tests/test_route53/test_route53.py +++ b/tests/t… | 2022-11-30 21:13:44 | Route53 should raise an exception when record already exists Hi, I'm trying to mock route53 and test my function, however, I noticed that m… | getmoto/moto | b4f0fb7137bdcb5b78d928d2ed1e751e9e1b2bdc | 4.0 | ['tests/test_route53/test_route53.py::test_update_hosted_zone_comment' 'tests/test_route53/test_route53.py::test_use_health_check_in_resou… | ['tests/test_route53/test_route53.py::test_change_resource_record_set_twice'] |
| 12 | getmoto__moto-5752 | Here's the culprit: https://github.com/spulec/moto/blob/8f074b0799e4e5303f219549e177d52b016c2dfb/moto/ssm/models.py#L1612 That line r… | diff --git a/moto/ssm/models.py b/moto/ssm/models.py --- a/moto/ssm/models.py +++ b/moto/ssm/models.py @@ -1606,22 +1606,26 @@ def _match_f… | diff --git a/tests/test_ssm/test_ssm_boto3.py b/tests/test_ssm/test_ssm_boto3.py --- a/tests/test_ssm/test_ssm_boto3.py +++ b/tests/test_ss… | 2022-12-10 20:23:01 | describe_parameters depends on filter order, but shouldn't # Summary When calling `ssm` `describe_parameters`, you can pass in a list of… | getmoto/moto | b2300f1eae1323e3e8bc45f97e530ce129dff12e | 4.0 | ['tests/test_ssm/test_ssm_boto3.py::test_get_parameters_should_only_return_unique_requests' 'tests/test_ssm/test_ssm_boto3.py::test_descri… | ['tests/test_ssm/test_ssm_boto3.py::test_describe_parameters__multiple_tags'] |
Auto-generated charts
Swe Gym: 500 rows by 11 columns. These exploratory charts are generated automatically from the data - open the dataset in Helix to ask your own questions.
Rows500
Columns11
Categorical cols2
Charts
repo by record count
Most common repo values across records.
Interesting queries to try
Columns
- instance_id text
- hints_text text
- patch text
- test_patch text
- created_at text
- problem_statement text
- repo categorical
- base_commit text
- version categorical
- PASS_TO_PASS mixed
- FAIL_TO_PASS mixed