Introduction to Machine Learning Laura Seletos
INTERACTIVE DEMO I m in an awesome machine learning talk and I wanted to tell you
WHY Should You Care?
1 Autonomous Cars WHY Should You Care?
1 Autonomous Cars WHY Should You Care? 2 Search Engines
1 Autonomous Cars WHY Should You Care? 2 Search Engines 3 Spam Filters
1 Autonomous Cars WHY Should You Care? 2 Search Engines 4 3 Healthcare Spam Filters
1 Autonomous Cars 5 WHY Should You Care? 2 Search Engines Financial Trading 4 3 Healthcare Spam Filters
Your Smart Phone 6 1 Autonomous Cars 5 WHY Should You Care? 2 Search Engines Financial Trading 4 3 Healthcare Spam Filters
Your Smart Phone 6 1 Autonomous Cars Financial Trading 5 2 Search Engines 4 3 Healthcare Spam Filters
BIO: HELLO WORLD Career IT Security Engineer and Consultant ReliaQuest Information Security System Administrator Raymond James Financial Enterprise Technical Account Manager Qualys Inc. Education Stetson University Degree in Computer Information Systems Dual minors in Management Information Systems (MIS) and Business Administration Community Involvement Member of InfraGard Current Member and Advisor of ISSA Tampa Bay Organized ISSA Tampa Bay s 2016 "Women in Security" forum Organized and Mentor the ISSA Tampa Bay CTF 2016 Competition Speaker/Presenter at University of Tampa, Stetson University, ISSA South FL, ISSA Tampa Bay, and IANS Charlotte Notable Hobbies Home lab, crypto currencies, machine learning, automation, CTFs, video games, etc.
AGENDA Evolution of Machine Learning (ML) Key Terminology Theory, Structures, & Examples Cyber Security Use Cases AI & ML Failures Tools and Resources Questions & Discussions
EVOLUTION OF ML Source: (https://www.cbinsights.com/research/arti ficial-intelligence-strategy)
KEY TERMS part 1 of 5 Artificial Intelligence (AI) The science of getting computers to act without being explicitly programmed Machine Learning (ML) A specific scientific method for building AI where an output is based on given goals and input data <Note> All Machine Learning is AI, but not all AI is Machine Learning </Note>
KEY TERMS part 2 of 5 Supervised Learning Training on a pre-defined set of examples Ensures more accurate conclusion with new data Unsupervised Learning No training Must find patterns & relationships in datasets Reinforcement Learning (RL) Reward feedback is given to teach behavior; this is known as the reinforcement signal Representation Learning (Feature Learning) Datasets that are not mathematically convenient Raw, real-world datasets like images, video, and sensor data Translates based on features or representations through examination without relying on explicit algorithms
KEY TERMS part 3 of 5 Classification (Supervised learning) The prediction variable takes class labels Example Predict the type of tumor (e.g. "benign" or "malignant") Regression (Supervised learning) The prediction variable takes continuous values Example Help with questions of How much? or How many? like house price (a real value) Clustering (Unsupervised learning) Analysis of data not included in pre-labeled classes Identifies & groups similar instances Example Pattern recognition, image analysis, information retrieval, bioinformatics, data compression, etc. Association (Unsupervised learning) Rule-based algorithm for discovering interesting relationships between variables in large datasets Example Cross-marketing & Customer behavior analysis Market Basket Analysis = Association between items chosen by shoppers
Source: Image via Abdul Rahid (https://www.slideshare.net/awahid/bigdata-and-machine-learning-for-businesses)
KEY TERMS part 4 of 5 Neural Networks (Neural Net) Just like any other network; Comprised of interconnected web of nodes, called neurons, and the edges that connect them together Main Functions: 1. Receive a set of inputs 2. Preform increasingly complex calculations 3. Use the outputs to solve a problem Nodes are assigned a number known as a weight In Training: Weights & thresholds are continually adjusted until labels consistently yield similar outputs Well suited for ML problems with gigantic inputs Neural Networks are used for lots of applications but this presentation focuses on Classification Source: https://www.kdn uggets.com/2015 /01/deep-learning -explanation-what -how-why.html
Source: https://giphy.com/gifs/neural-networks-sq7yhyvog031s NEURAL NET EXAMPLE The classification is determined by the score of each node The act of passing an input value from one layer to another = Forward Propagation (aka Forward Prop)
KEY TERMS part 5 of 5 Deep Learning Process of applying deep neural network technologies, with multiple layers of neurons, to solve problems Deep learning is a specialized form of machine learning Source: https://www.mathworks.com/discovery/deep-learning.html?s_eid=psm_da
LAYERS OF AI Artificial Intelligence Machine Learning Representation Learning (Also known as Feature learning) Deep Learning Source: Ian Goodfellow s (Scientist at Google Brain) Book: Deep Learning (http://www.deeplearningbook.org)
ML STRUCTURE Source: https://www.cbinsights.com/ research/artificial-intelligence-strategy
ML STRUCTURE part 2 Neural Network Classification Attributes: Source: http://slideplayer.com/slide/7337740/24/imag es/47/types+of+neural+networks.jpg
ML WORKFLOW Source: https://www.cbinsights.com/ research/artificial-intelligence-strategy
ML EXAMPLES
CYBER SECURITY EXAMPLES Insider Threat Detection Malware Analysis (variants) Network Analytics (abnormal) Incident Response Fraud Prevention Spam Detection Situational Awareness Support Chat / AI Training Structuring unstructured data Defensive & Offensive Pentesting (SQL Ex)
AI FAILS Facebook Shut down program after developers discovered AI had created its own language There was no reward to sticking to English language Target Predicted teen girl was pregnant before her family did Sent coupons for baby items according to client s pregnancy scores Microsoft s AI Chatbot Twitter teaches it how to be racist in less than a day Source: https://www.snopes.com/facebook-aideveloped-own-language/ Source: https://www.forbes.com/sites/kashmirhill/2012/02 /16/how-target-figured-out-a-teen-girl-waspregnant-before-her-father-did/#538652766686 Source: https://www.theverge.com/2016/3/24/11297050/t ay-microsoft-chatbot-racist
AI FAILS personal favorite Banana Toaster Google researchers developed a psychedelic sticker the effectively tricks deep learning systems into classifying the image as a toaster. Source: https://gizmodo.com/this -simple-sticker-can-trickneural-networks-intothin-1821735479
ML TOOLS & RESOURCES Top 8 Programming Languages for ML Python, Java, R, C++, C, JavaScript, Scala, Julia Free YouTube Training Video Deep Learning SIMPLIFIED: The Series Episodes 1-30 https://www.youtube.com/ watch?v=b99uvkwzytq List of Beginner ML Projects with Tutorials https://elitedatascience.co m/machine-learningprojects-for-beginners https://www.makeuseof.co m/tag/test-ai-coding-skillsprogramming-challenge/ Google.com! Source: https://techcrunch.com/2017/08/08/the-evolution-of-machine-learning
QUESTIONS? Laura Seletos Technical Account Manager lseletos@qualys.com Qualys, Inc. 1600 Bridge Parkway Redwood City, CA 94065 M 727 271 3205 www.qualys.com