SurrealDB Performance Benchmark

[theseusyang]

Anybody can show a surrealdb's benchmark, to describe the performance?

[tobiemh]

Hi @theseusyang thanks for starting the discussion!

We'll definitely be performing benchmarking for SurrealDB in due course.

Currently, we are focussed on functionality and stability, and want to make the following changes for performance: #26, #24, and #22.

Once those are implemented, performance should be far better than it is now!

[bencz]

Benchmarking is interesting...
Test, in addition to speed, the limits... for example, maximum number of simultaneous connections and etc

[JABirchall]

I'd also be interested in seeing some benchmarks.

Not a describe command, but for example a benchmark of the database loaded with data. Often times databases can start to lose performance with millions of records.

[Developeranees]

I'd also be interested in seeing some benchmarks.

[AlexFrid]

The benchmarks are currently being worked on, we've used some initial results to improve performance and will release benchmarks publically once we have improved on a few more things.

[FI-Mihej]

Hello!

I'm currently pondering whether I have the capability to utilize SurrealDB effectively. Is its performance significantly slow, or is it somewhat tolerable at this present moment, without considering future improvements?

[AlexFrid]

Hey @FI-Mihej,
As for the current state v1.1.0-beta very large aggregation queries can be annoyingly slow, as well as bulk inserts of millions of records might take much longer than expected if each record is also large or is a graph relation. Inserts of small records however perform well.

Apart from that, you'll find that most things perform similarly to comparable DBs with other things being tolerable.

Therefore I think you will currently be able to utilize SurrealDB effectively, as long as you can accept a few rough edges here and there.

[AlexFrid]

Now talking about future improvements, we are working towards ironing out these rough edges in time for our cloud offering.

[carueda]

I continue to be super interested in incorporating SurrealDB in some of my professional projects. However, I still interpret your answer to the Is SurrealDB ready for production use? FAQ basically as, "No, it's not." I'd be more that happy to be corrected, or simply learn about a more concrete timeline for significant performance improvements to land in a version (even if beta). Please keep up the great work.

[AlexFrid]

Hey @carueda,
It's basically ready for people who can accept the risks of being an early adopter 😅
You can see an example of an early adopter using it in production here: https://www.youtube.com/watch?v=kHnn1XTnZCk

What we are working on currently is making it ready for the more risk-averse early majority with 2.0, which will include some necessary breaking changes, but all the improvements that don't need a breaking change are being released in a 1.x release each month now.

[nottisa]

Replying to this as it seems it has not been addressed in quite some time. It does not appear that benchmarks are currently publicly available, but some pre-made benchmarking tools are available here: https://github.com/surrealdb/surrealdb/tree/main/lib/benches

[nickchomey]

They have stated various times that benchmarks will be made available when v2 is fully released. The first alpha was just released, so if folks can contribute with testing and feedback, the full v2 and benchmarks will come sooner.

[nottisa]

I only said what I said because the current benchmarking tools were not yet mentioned. I understand what they've said previously and am not discounting that.

[mahbubabbas]

I have used SurrealDB in 2 applications recently. Honestly speaking I feel Postgres is outperforming Surreal. I am not so happy with Surreal.

[AlexFrid]

Thanks for the feedback, could you say a bit more about what kind of application you were using it for and what postgres extensions you were using (if any)?

[MrBns]

Now SurrealDB 2.0 is out. is there any performance benchmark yet ?

[AlexFrid]

We're currently making them ready and the results and reproducible code will be out soon.

[MrBns]

@AlexFrid thanks 😊