Query a source

[gedw99]

https://github.com/julien040/anyquery allows Sal based querying of many data sources using golang plugin providers .

the plugins are not WASM but I am thinking about adding wazero and using stdio based way of interacting and piping them .

@ncruces I am only linking this because I remember how you could not easily do this with the other similar repo . Can’t remember its name . Think it was steam pipe ?

[ncruces]

Yes. I also discussed this a bit with the author here:
https://www.reddit.com/r/golang/comments/1en5dzl/anyquery_query_anything_json_github_notion/

I think a good solution complete avoids this stuff being out-of-process, grpc, whatever. I can do stuff to help out get to that good solution.

But, to be frank, count me out of a solution that involves all of the above. That just makes no sense, given how easy it is to implement my virtual table interfaces in Go.

[gedw99]

Yep I also feel that in process is the way to go, that’s why I suggested WASM plugins.

Maybe I am missing something , but stdio has been working well as the io for in process plugins.

[gedw99]

I just read the Reddit discussion .

it’s looks like all 3 of use agree that the rpc is overkill. WASM provides the isolation so a failure is fine.

You guys are thinking of using the SQLite virtual tables as the interface ? I did not get that bit. Can you explain for me :)

[ncruces]

That's what those are, virtual tables you can query. You implement an interface like this:
https://github.com/ncruces/go-sqlite3/blob/v0.18.0/vtab_test.go