How to build and use a thesaurus with synonyms to improve your text analysis algorithms in Python Natural Text Processing (NLP) is a hot topic at this moment. I have recently written some articles on this topic like Summarizing a text with Python, part I and part II Finding related…

Using ChatGPT to create code to generate images by DALL-E using the OpenAI API. OpenAI provides two of the greatest AI tools of the moment; a Large Language Model trained for conversational speech named chatGPT and text-to-image model Dall-E 2. ChatGPT is the successor of GTP-3 and is a stateful…

How to import a fixed-width file in Python to a dictionary (or a data frame) The most common text format for data is the comma (or semicolumn, or pipe, etc.) seperated format. But once in a while reading a fixed width text file is required. In this type of file…

How to move or migrate a project backlog to another DevOps team and location efficiently. “I did this before!” That was the first thing that occured to me when I was transferring a product backlog within Azure DevOps. It felt like reinventing the wheel since I did not remember in…

How to find related articles with TF-IDF. Implementing a TF-IDF algorithm in Python. — As mentioned in my article about Summarizing text, I have a collection of news articles spanning the last decade. After summarizing these articles, the next challenge I faced was finding related articles. If I have one article, how do I find articles related to this article? …

How to efficiently summarize a text with Python and NLTK and as a bonus the detection of the language of a text — In the article ‘Summarize a text with Python’ of last month I showed how to create a summary for a given text. Since then, I have been using this code frequently and found some flaws in the usage of this code. The summarize method is replaces with a class performing…

Eurostat is the main entry point for European statistics. This article helps you with the steep learning curve for using the data in Python. — Eurostat is the statistical office of the European Union. Their mission is to provide statistics and data on Europe. All the data is available for browsing and download. You can browse their complete database here. The final code of this article is available on my GitHub as easy_eurostat package.

How to efficiently summarize a text with Python and NLTK — Sometimes you need a summary of a given text. I ran into this challenge when I was building a collection of news posts. Using the complete text to interpret the meaning of an article took a lot of time (I have about 250.000 collected), so I started looking for a…

After the introduction into the usage of the Ergast dataset, it is time to analyze! In the previous article the F1Stats class was introduced as a convenient way to analyse the historical F1 data from Ergast. So now it is time to start using it! The possibilities are almost endless…