Ashhadul Islam

Ashhadul Islam

Harnessing AI to bridge visionary innovation with real-world impact.

Scraping Websites with Python, Selenium, and Tor: The Big Data Heist

less than 1 minute read

Published:

In this post, I tackle the common challenges faced when scraping websites, particularly the frustration of being blocked after making too many consecutive requests. I explore how to use Python, Selenium, and Tor to bypass these limitations, enabling you to continue scraping without interruptions.

Websites often block repeated requests from the same IP address to prevent Denial-of-Service attacks, which can significantly hinder your progress. By routing your requests through Tor, you can effectively disguise your IP address, making each request appear as though it’s coming from a different location.

This article walks you through the setup and implementation of these tools, providing a robust solution to keep your scraping projects running smoothly.

To read the entire article, visit the link.

You May Also Enjoy

Chat with Your Obsidian Notes Using the Falcon Mamba 7B Model

less than 1 minute read

Published:

In the age of information, it’s easy to drown in the sea of notes we’ve meticulously collected over time. Imagine having a chat application that understands your notes and fetches the exact information you need, no matter how vast your repository is. Enter Falcon Mamba 7B and Retrieval-Augmented Generation (RAG) — a perfect blend of speed, precision, and language understanding that turns your note-taking chaos into order.

Balancing Regression Datasets with KNNOR-Reg Oversampling Technique

less than 1 minute read

Published:

Enhancing model performance in machine learning often begins with addressing the quality of your data. One of the most challenging issues is the imbalance in the target variable distribution, which can severely impact the accuracy of regression models.

MemGPT: Assimilating Information from Multiple PDFs

less than 1 minute read

Published:

In this post, I explore the capabilities of MemGPT in handling Retrieval-Augmented Generation (RAG) tasks, particularly focusing on its ability to assimilate information from multiple PDF files. While GPT-4 has its strengths, it often struggles with tasks requiring the consolidation of information from several documents. MemGPT, on the other hand, excels in this area, as demonstrated through a series of comparisons.

Advanced Retrieval with LlamaPacks: Elevating RAG in Fewer Lines of Code!

less than 1 minute read

Published:

In this post, I explore five Retrieval-Augmented Generation (RAG) methods open-sourced by LlamaIndex, which claim to simplify the RAG process to just about one line of code. Through a series of experiments, I test these methods and compare their effectiveness in terms of accuracy and efficiency.