Blogs
"Knowledge brings liberation."
Writing a Compiler in Rust #1: Lexical Analysis
as someone who has a Computer Science Degree, it's a bit shameful for me to admit that I never formally studied compilers, well in my defense it's because it was an elective and I chose an ML elective instead of Compiler Design. Although it is something that I've always enjoyed hearing a lot about...
Related Topics
RUST
COMPILER
Transformers: Attention is all you need
I guess it's safe to say that Attention Mechanism and Transformers is something that recently took over NLP. Not only did it show improvements over the SOTA models at the time but also overcome the shortcoming of the RNN models like LSTM and GRU. So let's go ahead and break down the sections of the paper, Attention is all you ...
Related Topics
DEEP LEARNING
PAPER DISSECTION
Activation Functions - The why you never asked!
Deep Learning is probably one of those things that everyone thinks is magical and usually, I take immense pleasure in seeing the reaction they have when I tell them it's essentially matrices that are unlike the nodes they expect but Neural Networks aren't limited to that and neither, is that the thing, that makes it special...
Related Topics
DEEP LEARNING
PYTORCH
PyTorch Lightning: DataModules, Callbacks, TPU, and Loggers
When I was getting started with PyTorch one of the things that made me jealous was the fact that Tensorflow has so much support for monitoring the model performance. I mean I have to write a training loop with redundant steps while Tensorflow beginners were just passing and chilling...
Related Topics
DEEP LEARNING
EXPERIMENT TRACKING
PYTORCH LIGHTNING
Class Imbalance comes in Like a Lion
Keeping aside the fact that I butchered one of the greatest Video Game quotes of all time class imbalance can be a tricky thing to handle especially if you are a beginner. When I first encountered class imbalance I treated it normally, I know right, and not just that I measured the accuracy to judge the performance...
Related Topics
DATA PRE-PROCESSING
MACHINE LEARNING
Training SVM over Custom Kernels
One thing that always intrigued me about ML is that the more you learn about it the more you realize how little you know. One such case that happened to me a few months ago when a person asked me if I could help him in SVM and me being me I was like ...
Related Topics
SVM
MACHINE LEARNING
Computing the Mean and Std of a Dataset in Pytorch
PyTorch provides various inbuilt mathematical utilities to monitor the descriptive statistics of a dataset at hand one of them being mean and standard deviation.
Related Topics
PYTORCH
Reading rpt files with Pandas
In most cases, we usually have a CSV file to load the data from, but there are other formats such as JSON, rpt, TSV, etc. that can be used to store data. Pandas provide us with the utility to load data from them. In this article, we'll see how we can load data from an rpt file with the use of Pandas.
Related Topics
DATA LOADING
MACHINE LEARNING
Adding Mean and Median to Histogram in R
Visualizing data can help gather insights from it that descriptive statistics can't. Anscombe's Quartet shows us how those statistics could be misleading, hence it becomes to analyze the data visually. We'll see how we can create histograms in R Programming Language and how to add mean and median lines to them.
Related Topics
STATISTICS
R LANGUAGE
Y Scrambling for Model Validation
Y Scrambling is a method that one can use in order to test whether the predictions made by the model aren't made just by chance. It is used in the validation of multi linear regression QSPR models.This process is amazingly simple to execute, and we'll learn about it in detail.
Related Topics
MODEL VALIDATION
MACHINE LEARNING
Training Neural Networks with Validation using PyTorch
It's important that our network performs better not only on data it's trained on but also data that it has never seen before. Let's see how we can keep track of validation metric at each training step and also save the model weights with best performance.
Related Topics
PYTORCH
DEEP LEARNING
Adjusting Learning Rate of a Neural Network in PyTorch
Learning Rate's value determines how fast the Neural Network would converge to minima. We usually tune our parameters to find the best value for the learning rate. But is there a way we can improve this process?
Related Topics
PYTORCH
DEEP LEARNING
Data Exploration using Pandas GUI
Pandas is a tool that we use very often for manipulating the data, along with seaborn and matplotlib for Data Visualization. PandasGUI is a library that makes this task much easier by providing a GUI interface that can be used to make the task easier.
Related Topics
DATA ANALYSIS
AUTOMATED EDA
Deploying ML Models as API using FastAPI
Apart from the two mentioned there is another framework that is becoming quite popular, so much so that companies like Netflix and Uber are using it, and that framework is FastAPI.
Related Topics
DEPLOYMENT
MACHINE LEARNING
Data and its Types
Hello Fellow Readers. If you are here you're probably interested in Data Science and probably willing to take a dive in a wide golden ocean called Statistics. If I had to explain what stats is I'll say it is playing with data, and boy is it fun.
Related Topics
STATISTICS
Understanding Lightning DataModules
We can use DataLoaders in Lightning to train the model but Lightning also provides us with a better approach called DataModules. They are reusable and shareable class that encapsulates the DataLoaders with the steps required to process data.
Related Topics
DEEP LEARNING
PYTORCH LIGHTNING
Training Neural Networks using Pytorch Lightning
In PyTorch every time you start a project you have to rewrite those training and testing loop. Lightning fixes the problem by not only reducing boilerplate code but also providing added functionality that might come handy while training.
Related Topics
DEEP LEARNING
PYTORCH LIGHTNING
Training and Testing a Basic Neural Network using Pytorch
Google and FaceBook have blessed us with 2 of the most popular neural nets library TensorFlow and Pytorch that make the job quite easy. For this article I'll using Pytorch and I'll use Tensorflow in the next one.
Related Topics
DEEP LEARNING
PYTORCH
Herumb Shandilya | Made with Mantine — @krypticmouse