Recent News – Page 248

Unravel on HDInsight enables developers and IT Admins to manage performance, auto scaling & cost optimization better than ever.

We are pleased to announce Unravel on Azure HDInsight Application Platform. Azure HDInsight is a fully-managed open-source big data analytics service for enterprises. You can use popular open-source frameworks (Hadoop, Spark, LLAP, Kafka, HBase, etc.) to cover broad range of scenarios such as ETL, Data Warehousing, Machine Learning, IoT and more. Unravel provides comprehensive application performance management (APM) for these scenarios and more. The application helps customers analyze, optimize, and troubleshoot application performance issues and meet SLAs in a seamless, easy to use, and frictionless manner. Some customers report up to 200 percent more jobs at 50 percent lower cost using Unravel’s tuning capability on HDInsight.

To learn more please join Pranav Rastogi, Program Manager at Microsoft Azure Big Data, and Shivnath Babu, CTO at Unravel, in a webinar on June 13 for how to build fast and reliable big data apps on Azure while keeping cloud expenses within your budget.

How complex is guaranteeing an SLA on a Big Data solution?

The inherent complexity of big data systems, disparate set of tools for monitoring, and lack of expertise in optimizing these open source frameworks create significant challenges for end-users who are responsible for guaranteeing SLAs. Users today have to monitor their applications with Ambari which only provides infrastructure metrics to administer the cluster health, performance and utilization. Big Data solutions use a variety of open source frameworks. Monitoring applications running across all of these frameworks is a daunting task. Users have to troubleshoot issues manually by analyzing logs from YARN, Hive, Tez, LLAP, Pig, Spark, Kafka, etc. To get good performance, users may have to change settings in Spark executors, YARN queues, Kafka topic configuration, region servers in HBase, storage throttling, sizing of compute and more. Unravelling this complexity is an art and science.

Monitoring Big Data applications now made easy with Unravel

Unravel on HDInsight provides intelligent applications and operations management for Big Data a breeze. Its Application Performance Management correlates full-stack performance and provides automated insights and recommendations. Users can now analyze troubleshoot and optimize performance with ease. Here are the key value propositions of Unravel on HDInsight:

Proactive alerting and automatic actions

Proactive alerts on applications missing SLAs, violating usage policies or affecting other applications running on the cluster.
Automatic actions to resolve above issues using dynamic thresholds and company defined policies such as killing bad applications, re-directing apps based on priority levels.

Analyze app performance

Intuitive, end-to-end view of application performance with drill-down capabilities into bottlenecks, problem areas and errors.
Correlated insights into all factors affecting app performance such as resource allocation, container utilization, poor configuration settings, task execution pattern, data layout, resource contention and more.
Rapid detection of performance and cost issues caused by applications.

Following is an example of how Unravel diagnosed poor resource usage and high cost caused by a Hive on Tez application. Tuning the application using recommendations provided by Unravel reduced the cost of running this application by 10 times.

Here is an example of cluster utilization after using Unravel. Unravel enables you to utilize resources efficiently and auto scale the cluster based on SLA needs, which results in cost savings.

AI-driven intelligent recommendation engine

Recommend optimal values for fastest execution and/or least resource utilization including: data parallelism, optimal container size, number of tasks, etc.

The example below shows how Unravel’s AI-driven engine provides actionable recommendations for optimal performance of a Hive query.

Identify and automatically fix issues related to poor execution, skew, expensive joins, too many mappers/reducers, caching, etc.

Following is an example of Unravel automatically detecting lag in a real-time IoT application using Spark Streaming & Kafka and recommending a solution.

Get started with Unravel on HDInsight

Customers can easily install Unravel on HDInsight using a single click in Azure portal. Unravel provides a live view into the behavior of big data applications using open source frameworks such as Hadoop, Hive, Spark, Kafka, LLAP and more on Azure HDInsight.

After installing you can launch the Unravel application from the Applications blade of the cluster as shown below.

Try Unravel now on HDInsight!

Attend the webinar!

To learn more please join Pranav Rastogi, Program Manager at Microsoft Azure Big Data, and Shivnath Babu, CTO at Unravel, in a webinar on June 13 on how to build fast and reliable big data apps on Azure while keeping cloud expenses within your budget.

Summary

Azure HDInsight is the most comprehensive platform offering a wide range of fully-managed frameworks such as Hadoop, Spark, Hive, LLAP, Kafka, HBase, Storm, and more. We are pleased to announce the expansion of HDInsight Application Platform to include Unravel. Unravel provides comprehensive Application Performance Management (APM) across various open source analytical frameworks to help customers analyze, optimize, and troubleshoot application performance issues and meet SLAs in a seamless, easy to use, and frictionless manner.

Stay up-to-date on the latest Azure HDInsight news and features by following us on Twitter #HDInsight and @AzureHDInsight. For questions and feedback, please reach out to [email protected].

Improving experiences for all our customers is something that we obsess over. We know that advancements in technology and inclusive design can help unlock solutions that empower people with disabilities. We also recognize the need to work together — across the industry — to ensure that no one is left behind.

That is why Microsoft collaborated with Apple and industry organizations to develop an USB-IF Human Interface Design (HID) standard for braille displays. Announced by the USB Implementers Forum (USB-IF) today, the standard will enable plug and play support for braille displays and has received broad support from the tech industry, assistive technology (AT) companies and non-governmental organizations advocating for people who are blind or have low vision.

“Braille is the key to literacy, education, employment and success for blind people all over the world,” said Mark Riccobono, president of the National Federation of the Blind. “An HID standard that allows the seamless integration of refreshable braille displays across devices will make it easier for braille readers to use this critical tool at home, at school, on the job or on the go. The National Federation of the Blind is proud to be a partner in collaboration across technology companies to make braille a game changing priority in the twenty-first century.”

By working together across companies, technologies and devices, we can advance technology for people with disabilities and create a consistent approach for AT providers. The result of HID standardization will improve braille display implementation, decrease costs and time to market, and ultimately empower people who are blind and have low vision. This will simplify development, removing the need for braille devices to have custom software and drivers created for a particular operating system or screen reader. We anticipate support for the standard starting in 2019.

Braille is a critical component for literacy, education and employment for people who are blind or have low vision. The USB-IF HID standard for braille displays has received broad industry support, underscoring the need for plug and play support. Members of the USB-IF HID Working Group include Microsoft, Apple and Google. We have also seen support from organizations like the National Federation of the Blind and Vision Australia, in addition to AT companies like Help Tech GmbH, Baum, HumanWare, Orbit, Bristol Braille, Dolphin Computer Access, Freedom Scientific and NV Access.

“Just like most sighted people, our SuperNova users regularly switch between using their Windows PC and their iPhone. Effortlessly moving your braille display between those devices will be a hugely popular move for our customers,” said Mike Hill, Technical Director, Dolphin Computer Access.

The World Health Organization estimates that 253 million people have a form of visual impairment. Technology can play an important role in creating opportunities for people who are blind or have low vision, and we have the responsibility to help create a level playing field for everyone. We also live in a modern world where customers expect technology to work out of the box, across devices and platforms.

“The ability to quickly and easily connect braille displays to a range of devices at home, at school and in the workplace will be of great benefit to users, especially those who use their devices across several different platforms,” said Damian McMorrow, access technology product owner, Vision Australia.

We know that technology can help unlock barriers for people, and braille is a critical form of communication for many people around the world, whether at home or at work. The new standard is another example of how we can work together to create opportunities for more people and, ultimately, help improve the unemployment rate for people with disabilities.

Together, we can work to create a more inclusive world.

Tag: Recent News

Unravel, now on Azure HDInsight, helps devs build fast, reliable big data apps