Feat: restructuring, cleansing, performance improvements, RPC failover

.github/workflows/tests.yml

@@ -27,5 +27,6 @@ jobs:
         run: bun test
         env:
           RPC_ENDPOINT: https://api.devnet.solana.com/
+          BACKUP_RPC_ENDPOINT: https://api.devnet.solana.com/
           INDEXER_URL: https://staging-indexer.metadao.fi
           INDEXER_WSS_URL: wss://staging-indexer.metadao.fi

TODO.md

@@ -0,0 +1,7 @@
+TODO
+
+[] Insert conditional prices when new proposal is indexed - DONE
+[] Manage database connections better - probably a connection pool with dedicated channels for each major component
+[] Add telemetry - probably log calltrace when indexer crashes
+[] Add logging for db connections and health checks
+[] Unify v3 and v4 indexers to both either use croner or regular intervals (currently v3 uses cron and v4 uses regular intervals)

packages/database/drizzle/0014_lonely_wolfsbane.sql

@@ -0,0 +1,2 @@
+ALTER TABLE "markets" ADD COLUMN "base_amount" numeric;--> statement-breakpoint
+ALTER TABLE "markets" ADD COLUMN "quote_amount" numeric;