Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Transform] 增加表达式求值转换能力 #7990

Open
3 tasks done
ghostmickey opened this issue Nov 7, 2024 · 0 comments
Open
3 tasks done

[Feature][Transform] 增加表达式求值转换能力 #7990

ghostmickey opened this issue Nov 7, 2024 · 0 comments

Comments

@ghostmickey
Copy link

Search before asking

  • I had searched in the feature and found no similar feature requirement.

Description

上下游字段映射是否考虑加入表达式求值方式(比如Aviator),这样可以利用一些函数和计算公式来将上游数据转换为下游数据,提升轻量数据计算能力,避免用户开发过多的自定义转换包。

另外提个建议,开发自定义转换时,需要引用Transform包里面的一些类,比如org.apache.seatunnel.transform.common.AbstractCatalogSupportTransform、org.apache.seatunnel.transform.common.SeaTunnelRowAccessor等等,但是如果我构建的任务里面没有用到任何公共包里面的转换器,任务加载时的Classloader只会加载我自己的jar包而不会加载transform-v2的jar,导致任务执行时抛出了ClassNotFoundException。因此,我只能把transform-v2包全部shade到我的jar里面去,或者在任务的配置中加入一个完全不起作用的转换算子来引导Classloader加载公共包。是否考虑把这些公共类从transform-v2中剥离出来形成一个类似transform-common的包,那么我自定义算子只需要shade这个公共包就行

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant