Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration with other tools/frameworks #115

Open
mglowacki100 opened this issue Jan 8, 2020 · 2 comments
Open

Integration with other tools/frameworks #115

mglowacki100 opened this issue Jan 8, 2020 · 2 comments
Assignees
Labels
documentation Missing documentation or improvements in the existing one

Comments

@mglowacki100
Copy link

It'd be great to have a list of recommended tools and frameworks that could be easily integrated with fklearn to have production ready and reproducible pipeline.
Even better to have short examples of usage.
For example fklearn could be used with: https://pair-code.github.io/what-if-tool/ and mlflow.
How about kedro (https://github.com/quantumblacklabs/kedro), do you recommend it?

@mglowacki100 mglowacki100 added the documentation Missing documentation or improvements in the existing one label Jan 8, 2020
@caique-lima
Copy link
Contributor

@mglowacki100

Sounds as a nice idea. At nubank, our internal framework is similar to Kedro, so I think we can try to write something related to how they can integrate. I'm unsure if we can have an actual list, but maybe describe how to deploy using one frame can give us a nice idea of how to integrate with other ones

@caique-lima caique-lima self-assigned this Jan 9, 2020
@mglowacki100
Copy link
Author

mglowacki100 commented Jan 14, 2020

@caique-lima
I think toy-example, how to integrate with kedro would be enough, but if you have better approach it also would be great.
I'm really close to integrate fklearn with mlflow, but I've issue with mlflow itself.
In the meanwhile, here is a sample integration with https://pair-code.github.io/what-if-tool/:

# In[15]:
import dill as pickle
import pandas as pd
from witwidget.notebook.visualization import WitWidget, WitConfigBuilder
# In[16]:
data = pd.read_csv('outime_outspace_hdout.csv')
# In[17]:
data.columns, data.shape
# In[18]:
with open('fkl_model.pkl', 'rb') as pickle_file:
    prediction_function = pickle.load(pickle_file)
# In[19]:
config_builder = (WitConfigBuilder(data.values.tolist(), data.columns.tolist())
  .set_custom_predict_fn(prediction_function)
  .set_target_feature('y')
  .set_model_type('regression'))
# In[20]:
WitWidget(config_builder, height=800)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Missing documentation or improvements in the existing one
Projects
None yet
Development

No branches or pull requests

2 participants