Can I use the "writeToEventStore" Syntasa utility in my Syntasa Notebook to write results to a Syntasa Event Store?
RespondedI want to know if the "writeToEventStore" utility that I typically use in a Spark Processor is available to use in my Syntasa Notebook. If so, is there anything I need to be aware of to make this work properly? If not, how do I write the results of my notebook to an Event Store?
-
In 6.2.0 version, code utilities are not available to be used in Notebooks.
In the next version, we will make some of the utilities available. But definitions will be slightly different in Notebooks compared to Spark Code Processes.
In Spark Code Process, input datasets, dates to process, output dataset etc can be auto determined depending on how spark process is connected in the workflow.
But as notebook is generally independent, same semantics will not work. -
Thanks for the response. When you have clarity on what utilities will be available for notebooks please pass those along so we can document and fold into our testing plans. In the meantime, it sounds like the only way to write the results of my notebook to an event store is by setting up a pipeline in a Syntasa app using a Spark Processor that supports this utility. Which, I don't necessarily think is a terrible thing, but we'll (ideally) need a way to seamlessly transfer the notebook code to the app.
Please sign in to leave a comment.
Comments
2 comments