start package cocoon_server for shared server-side cocoon code (#4056)

`app_dart` and `auto_submit` provide essentially the same service from two different entrypoints. Right now it's annoying to have to maintain copies of various services like Bigquery, API auth clients, datastore, firestore, graphql, REST API, etc. Every time we decide to move a piece of functionality between `app_dart` and `auto_submit` it involves unnecessary code copying and movement. For example, notice how https://github.com/flutter/cocoon/pull/4043 had to duplicate `deleteBranch` in `app_dart`'s bespoke `github_service.dart`.

This PR introduces a local package `cocoon_server` depended on by both `app_dart` and `auto_submit`. This PR only moves `bigquery.dart` and `access_client_provider.dart`. Future PRs can move more shared code into `cocoon_server`. Eventually, `app_dart` and `auto_submit` could become thin shells over `cocoon_server` that simply adapt it to their respective runtime environments.
59 files changed
tree: a410f11dc7de6d68c8b5fef29efd92af4816345b
  1. .github/
  2. analyze/
  3. app_dart/
  4. auto_submit/
  5. cipd_packages/
  6. cloud_build/
  7. cocoon_server/
  8. dashboard/
  9. dev/
  10. gh_actions/
  11. licenses/
  12. packages/
  13. test_utilities/
  14. tooling/
  15. triage_bot/
  16. .ci.yaml
  17. .gitignore
  18. analysis_options.yaml
  19. AUTHORS
  20. CI_YAML.md
  21. cloudbuild_cron.yaml
  22. CODEOWNERS
  23. CONTRIBUTING.md
  24. cron.yaml
  25. format.sh
  26. LICENSE
  27. README.md
  28. tests.yaml
README.md

Flutter CI Status SLSA 3

Cocoon is a Dart App Engine custom runtime (backend) with a frontend of Flutter apps (build and repository dashboard). Cocoon coordinates and aggregates the results of flutter/flutter builds.

It is not designed to help developers build Flutter apps.

Cocoon is not a Google product.

Using Cocoon

Forcing a refresh from GitHub

The server is driven by commits made to https://github.com/flutter/flutter repo. It periodically syncs new commits. If you need to manually force a refresh, query https://flutter-dashboard.appspot.com/api/refresh-github-commits.

You will need to be authenticated with Cocoon to do this.

Developing Cocoon

Cocoon has several components:

  • A server, which coordinates everything. This is a Dart App Engine application. If you have never used that before, you may want to peruse the samples for Dart App Engine. The server is found in app_dart.

  • A Flutter app (generally used as a Web app) for the build dashboards. The dashboard is found in dashboard.

Cocoon creates a checklist for each Flutter commit. A checklist is made of multiple tasks. Tasks are performed by LUCI bots.

Getting started

First, set up a Flutter development environment. This will, as a side-effect, provide you with a Dart SDK. Your life will be easier if you add that (.../flutter/bin/cache/dart-sdk/bin/) to your path.

To update the production server, you will need the Google Cloud SDK. Since there is no Dart SDK, we just use the command line tools.

Developing the server

All the commands in this section assume that you are in the app_dart/ directory.

Running a local dev server

dart bin/local_server.dart

This will output Serving requests at 0.0.0.0:8080 indicating the server is working.

New requests will be logged to the console.

Deploying a test version on Google Cloud

To run live tests, build the app, and provide instructions for deploying to Google App Engine, run this command:

dart dev/deploy.dart --project {PROJECT} --version {VERSION}

You can test the new version by accessing {VERSION}-dot-flutter-dashboard.appspot.com in your browser. If the result is satisfactory, the new version can be activated by using the Cloud Console UI: https://console.cloud.google.com/appengine/versions?project=flutter-dashboard&serviceId=default

Optional flags

--profile: Deploy a profile mode of dashboard application for debugging purposes.

--ignore-version-check: Ignore the version of Flutter on path (expects to be relatively recent)

Developing the dashboard

The dashboard application will use dummy data when it is not connected to the server, so it can be developed locally without a dev server.

To run the dashboard locally, go into the dashboard directory and run flutter run -d chrome. The dashboard will be served from localhost (the exact address will be given on the console); copy the URL into your browser to view the application. (The dashboard should also be able to run on non-Web platforms, but since the Web is our main target that is the one that should generally be used for development.)

You can run flutter packages upgrade to update the dependencies. This may be necessary if you see a failure in the dependencies.