API: Migrate to Plan / Tier Tables #1099

ajay-sentry · 2025-01-15T17:40:57Z

Purpose/Motivation

This PR relies on this version of shared: codecov/shared#479.

The main objective of this PR is to migrate all Backend Service logic to use the new plan and tiers tables instead of the Plan constants. You can read more about milestone 3 here.

A core change introduced in this PR is the creation of mocks for plans and tiers, which are used in most test setup functions. To ensure efficient testing, we use setUpClass to set up these mocks once per test class, avoiding the need to recreate them for each test.

Links to relevant tickets

Closes codecov/engineering-team#3252

What does this PR do?

Include a brief description of the changes in this PR. Bullet points are your friend.

Notes to Reviewer

Anything to note to the team? Any tips on how to review, or where to start?

Legal Boilerplate

Look, I get it. The entity doing business as "Sentry" was incorporated in the State of Delaware in 2015 as Functional Software, Inc. In 2022 this entity acquired Codecov and as result Sentry is going to need some rights from me in order to utilize my contributions in this PR. So here's the deal: I retain all rights, title and interest in and to my contributions, and by keeping this boilerplate intact I confirm that Sentry can use, modify, copy, and redistribute my contributions, under Sentry's choice of terms.

codecov · 2025-01-15T17:51:56Z

Codecov Report

Attention: Patch coverage is 96.82540% with 2 lines in your changes missing coverage. Please review.

Project coverage is 96.10%. Comparing base (9f89174) to head (49f2af8).
Report is 2 commits behind head on main.

✅ All tests successful. No failed tests found.

Files with missing lines	Patch %	Lines
services/billing.py	88.23%	2 Missing ⚠️

Additional details and impacted files

@@           Coverage Diff            @@
##             main    #1099    +/-   ##
========================================
  Coverage   96.09%   96.10%            
========================================
  Files         832      835     +3     
  Lines       19507    19628   +121     
========================================
+ Hits        18746    18863   +117     
- Misses        761      765     +4

Flag	Coverage Δ
unit	`96.00% <96.82%> (-0.01%)`	⬇️
unit-latest-uploader	`96.00% <96.82%> (-0.01%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

codecov-notifications · 2025-01-15T17:52:07Z

Codecov Report

Attention: Patch coverage is 96.82540% with 2 lines in your changes missing coverage. Please review.

✅ All tests successful. No failed tests found.

Files with missing lines	Patch %	Lines
services/billing.py	88.23%	2 Missing ⚠️

📢 Thoughts on this report? Let us know!

codecov-qa · 2025-01-15T17:52:11Z

❌ 5 Tests Failed:

Tests completed	Failed	Passed	Skipped
2710	5	2705	7

View the top 3 failed tests by shortest run time

graphql_api/tests/test_owner.py::TestOwnerType::test_fetch_available_plans_is_enterprise_plan

Stack Traces | 0.442s run time

self = <graphql_api.tests.test_owner.TestOwnerType testMethod=test_fetch_available_plans_is_enterprise_plan>

    def test_fetch_available_plans_is_enterprise_plan(self):
        current_org = OwnerFactory(
            username="random-plan-user",
            service="github",
            plan=PlanName.FREE_PLAN_NAME.value,
        )
    
        query = """{
            owner(username: "%s") {
                availablePlans {
                    value
                    isEnterprisePlan
                    isProPlan
                    isTeamPlan
                    isSentryPlan
                    isFreePlan
                    isTrialPlan
                }
            }
        }
        """ % (current_org.username)
        data = self.gql_request(query, owner=current_org)
>       assert data == {
            "owner": {
                "availablePlans": [
                    {
                        "value": "users-basic",
                        "isEnterprisePlan": False,
                        "isProPlan": False,
                        "isTeamPlan": False,
                        "isSentryPlan": False,
                        "isFreePlan": True,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-free",
                        "isEnterprisePlan": False,
                        "isProPlan": False,
                        "isTeamPlan": False,
                        "isSentryPlan": False,
                        "isFreePlan": True,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-pr-inappm",
                        "isEnterprisePlan": False,
                        "isProPlan": True,
                        "isTeamPlan": False,
                        "isSentryPlan": False,
                        "isFreePlan": False,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-pr-inappy",
                        "isEnterprisePlan": False,
                        "isProPlan": True,
                        "isTeamPlan": False,
                        "isSentryPlan": False,
                        "isFreePlan": False,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-teamm",
                        "isEnterprisePlan": False,
                        "isProPlan": False,
                        "isTeamPlan": True,
                        "isSentryPlan": False,
                        "isFreePlan": False,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-teamy",
                        "isEnterprisePlan": False,
                        "isProPlan": False,
                        "isTeamPlan": True,
                        "isSentryPlan": False,
                        "isFreePlan": False,
                        "isTrialPlan": False,
                    },
                ]
            }
        }
E       AssertionError: assert {'owner': {'a...Plans': None}} == {'owner': {'a...False, ...}]}}
E         
E         Differing items:
E         {'owner': {'availablePlans': None}} != {'owner': {'availablePlans': [{'isEnterprisePlan': False, 'isFreePlan': True, 'isProPlan': False, 'isSentryPlan': Fals...Plan': False, ...}, {'isEnterprisePlan': False, 'isFreePlan': False, 'isProPlan': False, 'isSentryPlan': False, ...}]}}
E         Use -v to get more diff

graphql_api/tests/test_owner.py:1151: AssertionError

graphql_api/tests/test_owner.py::TestOwnerType::test_resolve_number_of_uploads_per_user

Stack Traces | 0.625s run time

self = <graphql_api.tests.test_owner.TestOwnerType testMethod=test_resolve_number_of_uploads_per_user>

    def test_resolve_number_of_uploads_per_user(self):
        query_uploads_number = """{
            owner(username: "%s") {
               numberOfUploads
            }
        }
        """
        repository = RepositoryFactory.create(
            author__plan=PlanName.BASIC_PLAN_NAME.value, author=self.owner
        )
        first_commit = CommitFactory.create(repository=repository)
        first_report = CommitReportFactory.create(
            commit=first_commit, report_type=ReportType.COVERAGE.value
        )
        for i in range(150):
            upload = UploadFactory.create(report=first_report)
            insert_coverage_measurement(
                owner_id=self.owner.ownerid,
                repo_id=repository.repoid,
                commit_id=first_commit.id,
                upload_id=upload.id,
                uploader_used=UploaderType.CLI.value,
                private_repo=repository.private,
                report_type=first_report.report_type,
            )
        query = query_uploads_number % (repository.author.username)
        data = self.gql_request(query, owner=self.owner)
>       assert data["owner"]["numberOfUploads"] == 150
E       assert None == 150

graphql_api/tests/test_owner.py:383: AssertionError

graphql_api/tests/test_owner.py::TestOwnerType::test_owner_plan_status

Stack Traces | 1.22s run time

self = <graphql_api.tests.test_owner.TestOwnerType testMethod=test_owner_plan_status>

    @freeze_time("2023-06-19")
    def test_owner_plan_status(self):
        current_org = OwnerFactory(
            username="random-plan-user",
            service="github",
            trial_start_date=timezone.now(),
            trial_end_date=timezone.now() + timedelta(days=14),
            trial_status=TrialStatus.ONGOING.value,
        )
        query = """{
            owner(username: "%s") {
                plan {
                    trialStatus
                }
            }
        }
        """ % (current_org.username)
        data = self.gql_request(query, owner=current_org)
>       assert data["owner"]["plan"] == {
            "trialStatus": "ONGOING",
        }
E       AssertionError: assert None == {'trialStatus': 'ONGOING'}

graphql_api/tests/test_owner.py:644: AssertionError

To view more test analytics, go to the Test Analytics Dashboard
📢 Thoughts on this report? Let us know!

codecov-public-qa · 2025-01-15T17:52:19Z

❌ 5 Tests Failed:

Tests completed	Failed	Passed	Skipped
2711	5	2706	6

View the top 3 failed tests by shortest run time

graphql_api/tests/test_owner.py::TestOwnerType::test_fetch_available_plans_is_enterprise_plan

Stack Traces | 0.442s run time

self = <graphql_api.tests.test_owner.TestOwnerType testMethod=test_fetch_available_plans_is_enterprise_plan>

    def test_fetch_available_plans_is_enterprise_plan(self):
        current_org = OwnerFactory(
            username="random-plan-user",
            service="github",
            plan=PlanName.FREE_PLAN_NAME.value,
        )
    
        query = """{
            owner(username: "%s") {
                availablePlans {
                    value
                    isEnterprisePlan
                    isProPlan
                    isTeamPlan
                    isSentryPlan
                    isFreePlan
                    isTrialPlan
                }
            }
        }
        """ % (current_org.username)
        data = self.gql_request(query, owner=current_org)
>       assert data == {
            "owner": {
                "availablePlans": [
                    {
                        "value": "users-basic",
                        "isEnterprisePlan": False,
                        "isProPlan": False,
                        "isTeamPlan": False,
                        "isSentryPlan": False,
                        "isFreePlan": True,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-free",
                        "isEnterprisePlan": False,
                        "isProPlan": False,
                        "isTeamPlan": False,
                        "isSentryPlan": False,
                        "isFreePlan": True,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-pr-inappm",
                        "isEnterprisePlan": False,
                        "isProPlan": True,
                        "isTeamPlan": False,
                        "isSentryPlan": False,
                        "isFreePlan": False,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-pr-inappy",
                        "isEnterprisePlan": False,
                        "isProPlan": True,
                        "isTeamPlan": False,
                        "isSentryPlan": False,
                        "isFreePlan": False,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-teamm",
                        "isEnterprisePlan": False,
                        "isProPlan": False,
                        "isTeamPlan": True,
                        "isSentryPlan": False,
                        "isFreePlan": False,
                        "isTrialPlan": False,
                    },
                    {
                        "value": "users-teamy",
                        "isEnterprisePlan": False,
                        "isProPlan": False,
                        "isTeamPlan": True,
                        "isSentryPlan": False,
                        "isFreePlan": False,
                        "isTrialPlan": False,
                    },
                ]
            }
        }
E       AssertionError: assert {'owner': {'a...Plans': None}} == {'owner': {'a...False, ...}]}}
E         
E         Differing items:
E         {'owner': {'availablePlans': None}} != {'owner': {'availablePlans': [{'isEnterprisePlan': False, 'isFreePlan': True, 'isProPlan': False, 'isSentryPlan': Fals...Plan': False, ...}, {'isEnterprisePlan': False, 'isFreePlan': False, 'isProPlan': False, 'isSentryPlan': False, ...}]}}
E         Use -v to get more diff

graphql_api/tests/test_owner.py:1151: AssertionError

graphql_api/tests/test_owner.py::TestOwnerType::test_resolve_number_of_uploads_per_user

Stack Traces | 0.625s run time

self = <graphql_api.tests.test_owner.TestOwnerType testMethod=test_resolve_number_of_uploads_per_user>

    def test_resolve_number_of_uploads_per_user(self):
        query_uploads_number = """{
            owner(username: "%s") {
               numberOfUploads
            }
        }
        """
        repository = RepositoryFactory.create(
            author__plan=PlanName.BASIC_PLAN_NAME.value, author=self.owner
        )
        first_commit = CommitFactory.create(repository=repository)
        first_report = CommitReportFactory.create(
            commit=first_commit, report_type=ReportType.COVERAGE.value
        )
        for i in range(150):
            upload = UploadFactory.create(report=first_report)
            insert_coverage_measurement(
                owner_id=self.owner.ownerid,
                repo_id=repository.repoid,
                commit_id=first_commit.id,
                upload_id=upload.id,
                uploader_used=UploaderType.CLI.value,
                private_repo=repository.private,
                report_type=first_report.report_type,
            )
        query = query_uploads_number % (repository.author.username)
        data = self.gql_request(query, owner=self.owner)
>       assert data["owner"]["numberOfUploads"] == 150
E       assert None == 150

graphql_api/tests/test_owner.py:383: AssertionError

graphql_api/tests/test_owner.py::TestOwnerType::test_owner_plan_status

Stack Traces | 1.22s run time

self = <graphql_api.tests.test_owner.TestOwnerType testMethod=test_owner_plan_status>

    @freeze_time("2023-06-19")
    def test_owner_plan_status(self):
        current_org = OwnerFactory(
            username="random-plan-user",
            service="github",
            trial_start_date=timezone.now(),
            trial_end_date=timezone.now() + timedelta(days=14),
            trial_status=TrialStatus.ONGOING.value,
        )
        query = """{
            owner(username: "%s") {
                plan {
                    trialStatus
                }
            }
        }
        """ % (current_org.username)
        data = self.gql_request(query, owner=current_org)
>       assert data["owner"]["plan"] == {
            "trialStatus": "ONGOING",
        }
E       AssertionError: assert None == {'trialStatus': 'ONGOING'}

graphql_api/tests/test_owner.py:644: AssertionError

To view more test analytics, go to the Test Analytics Dashboard
📢 Thoughts on this report? Let us know!

github-actions · 2025-01-15T17:52:19Z

✅ All tests successful. No failed tests were found.

📣 Thoughts on this report? Let Codecov know! | Powered by Codecov

ajay-sentry · 2025-01-15T21:09:03Z

api/internal/owner/serializers.py

@@ -131,11 +130,6 @@ def validate_value(self, value: str) -> str:
            plan["value"] for plan in plan_service.available_plans(current_owner)
        ]
        if value not in plan_values:
-            if value in SENTRY_PAID_USER_PLAN_REPRESENTATIONS:


Removed this because it would now just be an extra DB call for a log lol

api/internal/owner/serializers.py

…updates

billing/helpers.py

github-actions · 2025-01-21T21:43:11Z

This PR includes changes to shared. Please review them here: codecov/shared@fe16480...8277f6d

ajay-sentry · 2025-01-23T23:01:50Z

api/internal/owner/serializers.py

@@ -219,7 +222,7 @@ def get_plan(self, phase: Dict[str, Any]) -> str:
        plan_name = list(stripe_plan_dict.keys())[


This can probably be further cleaned up by doing a get on the stripe_id 🤔

ajay-sentry · 2025-01-23T23:20:04Z

upload/helpers.py

@@ -637,7 +637,10 @@ def validate_upload(
        owner = _determine_responsible_owner(repository)

        # If author is on per repo billing, check their repo credits
-        if owner.plan not in USER_PLAN_REPRESENTATIONS and owner.repo_credits <= 0:
+        if (
+            owner.plan not in Plan.objects.values_list("name", flat=True)


This is some mega legacy code, I don't think anyone is on per repo billing anymore and can probably be deleted tbh

RulaKhaled · 2025-01-24T11:07:22Z

billing/tests/test_views.py

@@ -69,17 +71,24 @@ def __getitem__(self, key):


 class StripeWebhookHandlerTests(APITestCase):
+    @classmethod
+    def setUpClass(cls):


ajay-sentry requested a review from a team as a code owner January 15, 2025 17:40

ajay-sentry requested a review from a team as a code owner January 15, 2025 20:02

ajay-sentry commented Jan 15, 2025

View reviewed changes

RulaKhaled reviewed Jan 16, 2025

View reviewed changes

api/internal/owner/serializers.py Outdated Show resolved Hide resolved

ajay-sentry added 6 commits January 20, 2025 10:28

starting transition, need the other PR merged to do imports and test …

947954a

…updates

other api stuff

a06b8c8

revert trial status changes, update other instances of plan stuff

1f2e63b

fix a couple instances... still need to fix availablePlans

5050704

a few more references for PAID and TEAM_PLANS

40abd2d

missing s

16f7fba

RulaKhaled reviewed Jan 20, 2025

View reviewed changes

billing/helpers.py Outdated Show resolved Hide resolved

add missing imports + refactor to call 1 query

3a5b3af

RulaKhaled force-pushed the Ajay/milestone-3-migration branch from bef1fa7 to 3a5b3af Compare January 20, 2025 11:51

RulaKhaled and others added 2 commits January 20, 2025 14:07

update tests

d26259a

testing locally, fix the tier checks and first test

f21a5f1

ajay-sentry and others added 3 commits January 21, 2025 15:47

starting to fix tests and some logic

ba63895

update api with mocked plans

91ea64b

fix all tests except account_viewset

42488fb

ajay-sentry changed the title ~~[WIP] Plan Milestone 3 Transitions~~ API: Migrate to Plan / Tier Tables Jan 23, 2025

ajay-sentry added 2 commits January 23, 2025 13:58

all tests passing now, fixed a couple small logic bugs too

1bfc6d8

fix this suite, when using ttestcase need to have setup vs setupClass

99a63e1

ajay-sentry mentioned this pull request Jan 23, 2025

Shared: Migrate to Plan / Tier Tables codecov/shared#479

Open

ajay-sentry commented Jan 23, 2025

View reviewed changes

clean up the logic for update plan

49f2af8

ajay-sentry commented Jan 23, 2025

View reviewed changes

RulaKhaled reviewed Jan 24, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

API: Migrate to Plan / Tier Tables #1099

API: Migrate to Plan / Tier Tables #1099

ajay-sentry commented Jan 15, 2025 •

edited by RulaKhaled

Loading

codecov bot commented Jan 15, 2025 •

edited

Loading

codecov-notifications bot commented Jan 15, 2025 •

edited

Loading

codecov-qa bot commented Jan 15, 2025 •

edited

Loading

codecov-public-qa bot commented Jan 15, 2025 •

edited

Loading

github-actions bot commented Jan 15, 2025 •

edited

Loading

ajay-sentry Jan 15, 2025

github-actions bot commented Jan 21, 2025 •

edited

Loading

ajay-sentry Jan 23, 2025

ajay-sentry Jan 23, 2025

RulaKhaled Jan 24, 2025

		@@ -219,7 +222,7 @@ def get_plan(self, phase: Dict[str, Any]) -> str:
		plan_name = list(stripe_plan_dict.keys())[

API: Migrate to Plan / Tier Tables #1099

Are you sure you want to change the base?

API: Migrate to Plan / Tier Tables #1099

Conversation

ajay-sentry commented Jan 15, 2025 • edited by RulaKhaled Loading

Purpose/Motivation

Links to relevant tickets

What does this PR do?

Notes to Reviewer

Legal Boilerplate

codecov bot commented Jan 15, 2025 • edited Loading

Codecov Report

codecov-notifications bot commented Jan 15, 2025 • edited Loading

Codecov Report

codecov-qa bot commented Jan 15, 2025 • edited Loading

❌ 5 Tests Failed:

codecov-public-qa bot commented Jan 15, 2025 • edited Loading

❌ 5 Tests Failed:

github-actions bot commented Jan 15, 2025 • edited Loading

ajay-sentry Jan 15, 2025

Choose a reason for hiding this comment

github-actions bot commented Jan 21, 2025 • edited Loading

ajay-sentry Jan 23, 2025

Choose a reason for hiding this comment

ajay-sentry Jan 23, 2025

Choose a reason for hiding this comment

RulaKhaled Jan 24, 2025

Choose a reason for hiding this comment

ajay-sentry commented Jan 15, 2025 •

edited by RulaKhaled

Loading

codecov bot commented Jan 15, 2025 •

edited

Loading

codecov-notifications bot commented Jan 15, 2025 •

edited

Loading

codecov-qa bot commented Jan 15, 2025 •

edited

Loading

codecov-public-qa bot commented Jan 15, 2025 •

edited

Loading

github-actions bot commented Jan 15, 2025 •

edited

Loading

github-actions bot commented Jan 21, 2025 •

edited

Loading