Ashhadul Islam

Ashhadul Islam

Harnessing AI to bridge visionary innovation with real-world impact.

Tipping the Scales: A Novel Augmentation Technique for Imbalanced Data

less than 1 minute read

Published:

In this article, I discuss the critical issue of imbalanced data in machine learning and introduce a novel augmentation technique designed to address this challenge. Even the most sophisticated models can fail if the underlying data is imbalanced, leading to misleadingly high accuracy rates while misclassifying minority cases.

For instance, consider a dataset with 9900 data points representing healthy patients and only 100 representing patients with an illness. A classifier trained on such data might incorrectly label all sick patients as healthy yet still report a 99% accuracy rate. This post delves into strategies to prevent such issues, ensuring your models are robust and reliable.

To read the entire article, visit the link.

You May Also Enjoy

Chat with Your Obsidian Notes Using the Falcon Mamba 7B Model

less than 1 minute read

Published:

In the age of information, it’s easy to drown in the sea of notes we’ve meticulously collected over time. Imagine having a chat application that understands your notes and fetches the exact information you need, no matter how vast your repository is. Enter Falcon Mamba 7B and Retrieval-Augmented Generation (RAG) — a perfect blend of speed, precision, and language understanding that turns your note-taking chaos into order.

Balancing Regression Datasets with KNNOR-Reg Oversampling Technique

less than 1 minute read

Published:

Enhancing model performance in machine learning often begins with addressing the quality of your data. One of the most challenging issues is the imbalance in the target variable distribution, which can severely impact the accuracy of regression models.

MemGPT: Assimilating Information from Multiple PDFs

less than 1 minute read

Published:

In this post, I explore the capabilities of MemGPT in handling Retrieval-Augmented Generation (RAG) tasks, particularly focusing on its ability to assimilate information from multiple PDF files. While GPT-4 has its strengths, it often struggles with tasks requiring the consolidation of information from several documents. MemGPT, on the other hand, excels in this area, as demonstrated through a series of comparisons.

Advanced Retrieval with LlamaPacks: Elevating RAG in Fewer Lines of Code!

less than 1 minute read

Published:

In this post, I explore five Retrieval-Augmented Generation (RAG) methods open-sourced by LlamaIndex, which claim to simplify the RAG process to just about one line of code. Through a series of experiments, I test these methods and compare their effectiveness in terms of accuracy and efficiency.