Skip to content

Custom CLI Mode with Manual import for Functions #14588

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Spaarsh opened this issue Feb 10, 2025 · 1 comment
Open

Custom CLI Mode with Manual import for Functions #14588

Spaarsh opened this issue Feb 10, 2025 · 1 comment
Labels
enhancement New feature or request

Comments

@Spaarsh
Copy link
Contributor

Spaarsh commented Feb 10, 2025

Is your feature request related to a problem or challenge?

As we increase the number of functions in our core, it might lead to an increased runtime footprint for datafusion-cli in the future. This increase will be due to functions that a lot of users with specific use-cases in mind wouldn't need. The same can be claimed for users using the cli for a more general purpose.

Describe the solution you'd like

Adding a new feature wherein a user pass a flag while starting the datafusion-cli that will start the CLI with a "bare-bones" set of functions. These functions shall be the absolutely necessary ones. Then the user shall manually import the set of functions as needed.

This feature primarily aims to provide users with more customization along with a reduced runtime footprint.

Describe alternatives you've considered

No response

Additional context

This idea originated from the discussion on creating a separate crate for spark functions. The idea of having an import command was first mentioned there. This issue proposes to provide the import command in context of a custom cli.

The original comment: #5600 (comment)

@Spaarsh Spaarsh added the enhancement New feature or request label Feb 10, 2025
@Spaarsh
Copy link
Contributor Author

Spaarsh commented Feb 10, 2025

I am willing to work on this issue once it is validated by the community.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant