Emerging Trends in Big Data, Analytics, Machine Learning, and Interne…

Customer requirements are evolving Data variety and data volumes are increasing rapidly Customers want to democratize access to data in a governed way Security and cost remain key decision factors Analytic needs are evolving beyond batch reports to real-time and predictive Customers are looking to incorporate voice, image recognition, and IoT use cases into applications 3. 2018, Amazon Web Services, Inc. or its Affiliates. Traditionally, analytics used to look like this 4. 2018, Amazon Web Services, Inc. or its Affiliates. Exchange Data • 12 equities markets • 4 options markets SIP Data • SIP trades • SIP NBBO • OPRA Broker Dealer data • 4000 plus firms Third Party Data • Bloomberg • Thompson Reuters • DTCC • OCC Management Amazon S3 Amazon Glacier Intake Linkage Normalization Validation Analytics Amazon Redshift Amazon EMR Machine Learning API API RDS IAM KMS Usage Stats • 33k • 20Pb Structured and unstructured data Millions of documents 25K data checks daily Normalization 33,000 servers daily Centralized data Normalized data Integrated data Discoverable Direct data query ML/AI platforms Applications/ Visualizations 19. Serverless Analytics Deliver cost-effective analytic solutions faster $ 24. Video Amazon Rekognition Video 1. Video is uploaded and stored to S3 2. Rekognition Video creates metadata for people and objects with time segments for search 4. Lambda also pushes the metadata and confidence scores into Elasticsearch 3. The output is persisted as metadata into DynamoDB to ensure durability Amazon Rekognition Video AWS LambdaAmazon S3 Amazon Elasticsearch Amazon DynamoDB 26.