Articles on 0dust's Blog

Weekly Check-in #13

himanshutripathi366@gmail.com (0dust) — Mon, 31 Aug 2020 14:12:47 +0000

What did I do this week?

Finalised everything! My last PR on scikit operations tutorial got merged and this marks the completion of GSoC project.

What's next?

I will keep contributing to DFFML and help others to come and contribute to open source. :)

Did I get stuck somewhere?

No, this week didn't involve any new work, I only went through the old work that I did.

Weekly Check-in #12

himanshutripathi366@gmail.com (0dust) — Tue, 25 Aug 2020 16:08:39 +0000

What did I do this week?

I finished documenting sklearn operations.

Did I get stuck somewhere?

No, everything worked out easily.

What's next?

Will make any changes as per mentor's review.

Weekly Check-in #11

himanshutripathi366@gmail.com (0dust) — Tue, 18 Aug 2020 02:54:40 +0000

What did i do this week?

Working on scikit operation documentation.

What's next?

Will be wrapping up the documentation and example usage.

Did I get stuck somewhere?

Yes, got stuck in example usage. Will resolve today in weekly meeting.

Weekly Check-in #11

himanshutripathi366@gmail.com (0dust) — Mon, 10 Aug 2020 17:07:53 +0000

What did I do this week?

I continued my work on documentation.

What's next?

Will try to wrap up the operations documentation by this week.

Did I get stuck somewhere?

No, everything is going smoothly.

Weekly Check-in #10

himanshutripathi366@gmail.com (0dust) — Tue, 04 Aug 2020 16:00:52 +0000

What did i do this week?

I worked on documenting the new scikit operations.

What's next?

I will work on improving documentation and adding more tests wherever needed.

Did I get stuck somewhere?

Yes, I got stuck while implementing the example usage. I will discuss it in the weekly meeting with my mentors.

Weekly Check-in #9

himanshutripathi366@gmail.com (0dust) — Mon, 27 Jul 2020 12:24:32 +0000

What did i do this week?

I worked on wrapping spacy and scikit learn functions as operations. I discussed with my mentors regarding the examples usage of these operations to be added to documentation. I also added spacy statistical NER model. The previous example usage PR got merged after few minor changes.

What's next?

I will be documenting the example usage of new operations that I recently added.

Did I get stuck somewhere?

I got stuck while wrapping scikit learn classes. I had a good discussion in weekly meeting with my mentor and fellow contributors and it got resolved.

Weekly Check-in #8

himanshutripathi366@gmail.com (0dust) — Mon, 20 Jul 2020 17:01:02 +0000

What did I do this week?

I worked on adding new operations. Also I made changes in the pull request as per mentor's review.

What's next?

i will keep working on adding new operations and their example usage in documentation.

Did I get stuck somewhere?

No, this week went clean. Also i got my laptop repaired on Tuesday!

Weekly Check-in #7

himanshutripathi366@gmail.com (0dust) — Mon, 13 Jul 2020 16:15:03 +0000

What did i do this week?

I worked on integrating NLP operations with tensorflow dnnclassifier for text classification. I also added an example usage of the same in documentation.

What's next?

I will be working on adding more NLP operations this week.

Did I get stuck somewhere?

Yes, I got stuck in CI test, it was failing but i wasn't able to reproduce it on my system. It got resolved in weekly meeting.

Also on Saturday, screen of my laptop went black. I couldn't give it for repairing on the same day as the state government imposed complete lockdown on weekend. I gave it for repairing today, it should be good to go by tomorrow.

Weekly Check-in #6

himanshutripathi366@gmail.com (0dust) — Mon, 06 Jul 2020 15:48:03 +0000

What did I do this week?

I discussed adding NLP operations with my mentors in a weekly meeting. I worked on two operations to begin and created a PR.

What's next?

I will be working on using these operations to train a TensorFlow model and do predictions using it.

Did I get stuck somewhere?

Yes, I got stuck in writing operations but it was resolved by discussion with fellow mates.

Weekly checkin #5

himanshutripathi366@gmail.com (0dust) — Mon, 29 Jun 2020 17:03:53 +0000

What did i do this week?

I finished adding QA models and the PR got merged. With this i wrapped up adding models to DFFML which was the first part of my project.

What's next?

I already started reading for my second part of the project which is adding NLP operations. I will be discussing with my mentors regarding different approaches to add these operations.

Did i get stuck somewhere?

No, it was smooth. There was a bug that creeped in and we realized that after PR was merged. So I made a small PR to fix that.

Weekly Check-in #4

himanshutripathi366@gmail.com (0dust) — Mon, 22 Jun 2020 16:48:41 +0000

What did I do this week?

I added few more tests in classification model as per mentor's suggestion and got the PR merged, Yayy! I also finished writing the accuracy and predict methods for QA model and added the unit tests.

What's next?

I will be adding integration tests and example usage of QA model and thus will finish the first part of the project by this week!

Did I get stuck somewhere?

No, this week was pretty smooth. I had few confusions which were resolved in weekly meetings.

Weekly Check-in #3

himanshutripathi366@gmail.com (0dust) — Mon, 15 Jun 2020 17:23:41 +0000

What did I do this week?

I finished adding the classification models and opened the PR for review. I also worked on Question Answering model but soon realised the complexity of implementing it in Tensorflow. So I switched to Pytorch and made a good progress so far.

What's next?

I will be finishing the Accuracy and Predict methods for QA model and will open the PR for review by mentors. I will also be making changes, if any, in classification model as per the instruction of mentors.

Did I get stuck somewhere?

I got stuck while implementing accuracy method for QA model. Due to the complexity of SQuAD metric it was getting quite complex to implement it in tensorflow. Luckily its lot easier to implement in Pytorch so the problem was resolved once I switched to Pytorch.

Weekly Check-in #2

himanshutripathi366@gmail.com (0dust) — Mon, 08 Jun 2020 14:32:19 +0000

What did I do this week?

I worked on question answering and classification models using Hugging Face Transformers. Now, both question answering and classification models can be trained in DFFML.

What's next?

I will be adding the Accuracy and Prediction method for question answering model and will wrap up the classification model to open pull request for review by mentors.

Did I get stuck somewhere?

Yes, I got stuck in reading the json file of SQuAD dataset for QA model. As you already know my mentor is super helpful so it got resolved quickly.

Weekly Check-in #1

himanshutripathi366@gmail.com (0dust) — Tue, 02 Jun 2020 01:21:08 +0000

Hello there, I am Himanshu Tripathi, a final year CS undergrad from NIT Silchar. I have been contributing to DFFML from past few months and got selected to spend this summer (and lockdown :P) working on Adding Machine Learning models and Operations in DFFML

What did I do this week?

I worked on DataFlow Diagrams. Diagrams show the input and output flow of data among operations in DFFML using Mermaidjs. I added the feature to show the conditional dependence of one operation on the others if there exist any.

Ok, What's next?

I wil be working on adding Question Answering model in DFFML.

Did I get stuck somewhere?

Yes, I got stuck in few places, but we have meeting twice a week and my mentor is very active (Yayy!) so everything got resolved quickly.