Starting Py-Fun

This post can now be found here

 

💡The Idea

I wanted a way to document and encourage practicing of my experiments with Python and integrating it with Azure ML, Power BI which is a major project I am currently working on.


📋The Plan

I am going to blog as regularly as possible covering the Python exploration and investigation that I am doing.

The plan is to help document the challenges and experience of trying to work to bring Python into the Microsoft Power Platform and processes that are used in my team. This area is something that I have not found many resources about in my work so far so I am conscious that some of this may be of help to others which is another reason to put this into a blog.

👣Next Steps

1) Publish this post
2) Start looking at Natural Language Processing in Python (using Jupyter notebooks)
3) Convert Jupyter code to Power BI for use in data models

Comments

Post a Comment

Popular posts from this blog

Rapid Automatic Keyword Extraction (RAKE) in Power BI

Image
 This post can now be found here I like Python but it needs more acronyms In this post I am going to go through the basic use of Rapid Automatic Keyword Extraction (RAKE) using the Natural Language Tool Kit (NLTK) as documented here .  So before we get into RAKE what is NLTK? It is a set of tools that do some quite similar stuff to Natural Language Processing as used in the spaCy Position of Speech (POS) and Named Entity Recognition (NER) tools that are explored here . Essentially the tools break down text into their component parts for scripts like RAKE, POS, NER to return results based on analysis of those components. What is RAKE? This tool extracts key words and phrases based on frequency and without any understanding of the context of the text being analysed. This makes it quite a general tool that will not work well with all text sources but like POS and NER is a good exploratory tool and may work well when joined up to other information about the text data. As an exampl...
Read more

Local Authority Shape Map in Power BI

Image
 This post can now be found here Thought it was about time to get in shape This is a bit of a tangent but wanted to share useful links as this is something that I have pulled together with multiple sources and not something that I could find a joined view of. So maps are tricky. Getting your data in the right format, right place and most difficult correct shape is really difficult. One approach is to focus only on getting your data in the right place by using latitude and longitude to plot data in the correct places but shape maps are definitely the best way to present data about geographies such as Countries, Regions, Local Authorities, Postcode Areas etc. Out of the box there are a few shape maps like US states, UK countries but for my purposes I need shape maps for Local Authorities, Postcode Areas, Regions and other geographic distributions inside the UK. Custom maps can be loaded and as this article says:  "You can use custom maps with Shape Map as long as they are in th...
Read more

Natural Language Processing in Power BI

Image
This post can now be found here With great Power BI comes great responsibility It is time: Power BI + Python = Amazing!  It worked, it is relatively easy to convert the code to run within Power BI. The main thing that changes is the emphasis of using print() or exporting data in some ways things are easier in that you just need to update or create data frames so 🐼s is key... Pandas . In terms of a step by step guide the first thing I did was get the code working in Jupyter as a proof that the code will execute successfully.  Following on from using spaCy . When you add a Python Script to a Power BI Query it basically takes the data as it stands in the previous step and converts it to a data frame called dataset. This means that for the code I had for spaCy the name "df" needed to be changed to "dataset". The other thing that needs to be different is what you do with the outputs of your code. I previously was printing out the values to test that it was working whic...
Read more