Ashhadul Islam

Ashhadul Islam

Harnessing AI to bridge visionary innovation with real-world impact.

Balancing Regression Datasets with KNNOR-Reg Oversampling Technique

less than 1 minute read

Published:

Enhancing model performance in machine learning often begins with addressing the quality of your data. One of the most challenging issues is the imbalance in the target variable distribution, which can severely impact the accuracy of regression models.

Consider a scenario where your dataset includes 9900 data points for typical house prices and only 100 data points for luxury house prices. A regression model trained on such data is likely to underpredict luxury house prices due to the overwhelming presence of typical prices, despite seemingly good performance on average.

To address this issue, my colleagues Dr. Khelil, Dr. Samir, Dr. Ala, Dr. Abdulsalam, and I at Hamad Bin Khalifa University and the Geneva School of Economics and Management have developed a novel data augmentation algorithm: KNNOR-Reg. This technique changes the distribution of minority data points based on specific parameters, enhancing the model’s ability to make accurate predictions in imbalanced regression problems.

To read the entire article, visit the link.

You May Also Enjoy

Chat with Your Obsidian Notes Using the Falcon Mamba 7B Model

less than 1 minute read

Published:

In the age of information, it’s easy to drown in the sea of notes we’ve meticulously collected over time. Imagine having a chat application that understands your notes and fetches the exact information you need, no matter how vast your repository is. Enter Falcon Mamba 7B and Retrieval-Augmented Generation (RAG) — a perfect blend of speed, precision, and language understanding that turns your note-taking chaos into order.

MemGPT: Assimilating Information from Multiple PDFs

less than 1 minute read

Published:

In this post, I explore the capabilities of MemGPT in handling Retrieval-Augmented Generation (RAG) tasks, particularly focusing on its ability to assimilate information from multiple PDF files. While GPT-4 has its strengths, it often struggles with tasks requiring the consolidation of information from several documents. MemGPT, on the other hand, excels in this area, as demonstrated through a series of comparisons.

Advanced Retrieval with LlamaPacks: Elevating RAG in Fewer Lines of Code!

less than 1 minute read

Published:

In this post, I explore five Retrieval-Augmented Generation (RAG) methods open-sourced by LlamaIndex, which claim to simplify the RAG process to just about one line of code. Through a series of experiments, I test these methods and compare their effectiveness in terms of accuracy and efficiency.

Super Quick: Retrieval Augmented Generation Using Ollama

less than 1 minute read

Published:

In this post, I delve into the capabilities of Ollama, a powerful infrastructure that simplifies local execution of open-source models and interactions with PDFs. Ollama acts like a Docker system for Large Language Models (LLMs), allowing easy setup of local LLM servers, fine-tuning, and more.