What did you do this week?

This week I worked on refactoring the the data cleanup operations, I made a mistake was not aware that we had a script which generates the python package template for us. Worked on refactoring the code. Also started working on creating an example on how to use the data clean up operations using a dataset from the real world.

What is coming up next?

Next I will be implementing two more examples on how we can work with cleaning of dataset within the dataflow itself.

Did you get stuck anywhere ?

Yes I was needed help with how we can pass List[List[int]] type data to the cleanup operations which works on each records and not on whole dataset, Figured out we have to implement operation Implementation class for it.