-
Notifications
You must be signed in to change notification settings - Fork 3
What tools we use
We don't really have a specified technology stack. It's usually whatever stack works to deliver the solution in a simple, secure and clean way.
We use the Australian Government Design System for all front end work. This been built by and for government front end applications.
We prefer to use GatsbyJs for building static sites. The whole team knows markdown, so we use github/markdown for the CMS aspect of these static applications.
We use NodeJs for most of our backend applications. It's easy to use and fast to set up.
Most of our web applications are hosted on cloud.gov.au.
Circle CI is used for CI/CD. You can ask the cloud.gov.au team to set up deployment environment variables in your circleCI app.
We use Figma for design because it's cross platform and works in browser, making it easy to share designs with anyone.
Tool to develop data pipeline using python
Data warehouse to store and process large volume of data for analytics
Access to BigQuery
• Request Business Service Team (BST) to create @digital.gov.au account
• Request product manager/data engineer to grant permissions for BigQuery
Access to Google Cloud Storage
• Request Business Service Team (BST) to create @digital.gov.au account
• Request product manager/data engineer to grant permissions for Google Cloud Storage
BigQuery SQL to extract semi-structure data
Data translation and formatting
Google’s visualisation tool to produce data reports
Data Visualisation tool to produce data reports using advance scripting machine learning tools
The data scripts developed in SQL and Python are available in following Github repository.
The scripts are used to build data pipelines.
• Galileo repository
• Observatory Service – the details of data scripts can be found in documentation guide.
Editor SQL and Python scripts integrated with github
Limited function for code editing
SQL code parsing for syntax and executing code