Cc Several Ssn with airSlate SignNow

Verify ssn field

and welcome to another episode of the pythonic accountants today we're gonna do something really fun so I've been thinking about showing you something called regular expressions which is a great way to identify patterns and the two things that that can be really useful for in accounting are one finding specific things that you need to find from a data set such as email addresses phone numbers or social security numbers other things like that or you know if you're trying to extract certain records from a semi-structured or unstructured data that's another time that you know pattern matching can be really useful so in this case we're gonna use it for showing you how you can identify things that look like social security numbers or maybe we can look for some birth dates too so this is useful because in accounting oftentimes you'll have access to sensitive data with PII personally identifiable information and you want to make sure you've got a good handle on what data you have that has PII and stripping it or hiding it in situations where you're giving that data it's other people and make sure your safeguard that data so I found that there is the the Enron email data set publicly available it's a 1.7 gigabyte file that is in a format called tarred and gzipped so I downloaded this and I'm having a good time kind of playing around with it so what I've done so far is there's a standard library called tar file and that's used to read this tar file and so I've already written this code we're gonna play around and change it a little bit so we're gonna import tar file and re which is regular expressions here we're creating two regular expression compilations which can be used to then search for these patterns so this first one is a Social Security number pattern so if this works is it's kind of like its own programming language in and of itself the backslash D means I want to digit this curly brace is 3 tells me I want three of these digits in a row it doesn't matter with digit this is just I'm looking for a - then here I'm one two digits another - and four digits so here I'm looking for a standard format of social security number this next one email is I'm looking for a slash backslash capital S so normally the backslash S means a space but the capital S means a not space so here I'm looking for a not space and then the plus sign means I mean I won one or more so one or more non spaces followed by an @ symbol followed by one or more not spaces followed by a dot followed by again one or more not spaces so let's actually show you what this looks like so let's do SSN dot find all and hi my name is Bob and my social is one two three four five six seven eight and there you have it it extracted the SSN say my email is Bob at ports calm and so it's not gonna get the email but if let's say we try you know and give you the email if it's got another one my wife's email whoops my wife email is Sarah at parts com it's gonna give you both the things that look like emails now here's here's something that you know is a little bit of a flaw in my regular expression is I found this period after the sentence so maybe I should say I just want letters and numbers so I can change that to say okay I want it a to z a to z 0 to 9 and then I can copy that and do the same thing here and do the same thing here and now it got rid of that dot so that's cool that was not that hard actually so um let's play around here so I'm gonna open up the file this no that was very quick oh let's see if that's okay oh this is the one that takes a little while items equals I get members so this is take probably about a minute it's not too bad and then I'll explain what this code here does and then I run it once this finishes running so I am iterating through just the first hundred thousand email files and I'm using something called enumerate which gives me both the index numbers like the item number looks already done gives you the item number and the actual file data and then what we're doing here is extracting the file information into this variable F and then here we're trying to decode it comes in a format called bytes and we're trying to decode it into normal string and we just skip it if it doesn't work and then here we're trying to find anything looks like a social let's go ahead and find emails equals emailed final content and then what we'll do is found so it looks like an SSN and actually actually yeah here's what I'll do print related emails are emails this tells us who sent it and then this creates a blank line so let's see what we find sure enough we've already found something so it looks like a social and item number 50 602 there's social the emails that are also found in that file are these three and you know if it repeats it'll if the same emails found more than once it'll repeat it here so it might be better to turn this into a set so it only gives you a unique list of emails but I don't really care right now so this is kind of interesting look at all these emails that people send with a social inside it that's insane let's um let's do something fun let's let's look for the word shred see if we find any emails I have the word shred in it so now I don't have to worry about the socials right now so we're gonna say if let's see contents dot let's see if shred and content lower France content and then I'm just gonna skip this coming this out for now let's see I didn't find anything interesting there oh boy looks like I'm freezing my screen cuz I found a lot of stuff this was maybe a mistake to look for the word shred and a hundred thousand emails well you know what I'm gonna leave this here this is a fun game to play I'm gonna turn it over to you if you're interested in trying this out I definitely recommend playing around with it a lot of interesting stuff you can probably gain from this data set it looked like there's actually some interesting stuff that other people have done based on some of these links here so hope you enjoyed the video this was how you can use regular expressions to find things that look like Social Security numbers or emails mainly for the purpose of determining if there's any personally identifiable information so if you liked the video click like and subscribe to the channel and hope you have a good one see you later