Posted on Leave a comment

AI takes the pain out of car insurance in India

India’s drivers benefit as artificial intelligence transforms the business of policies and claims

Auto insurance is becoming a lot easier and quicker – with the help of artificial intelligence and smartphones.

India is one of the world’s largest and fastest-growing auto insurance markets – but until now, the sector has had to rely on traditional ways to renew lapsed policies or make repair claims. Both services have required inspectors to physically look over vehicles and make damage assessments.

In a country with more than 230 million vehicles and 1200 auto accidents every day, scheduling inspections and getting approvals can keep cars and policyholders off the road for days or longer. A more convenient way was needed.

To ease the pain, ICICI Lombard has partnered with Microsoft to develop India’s first AI-enabled car inspection feature in its mobile app, “Insure.” The app allows customers to buy or renew policies anytime, anywhere. And, soon it will also simplify the process of making a repair claim.

In case of lapsed policy instead of a physical inspection, customers can simply take images of their vehicle and upload them with Insure. The app then uses artificial intelligence (AI) and machine learning to divide the images into frames and identify the various parts of the car to look for damage. In most cases the AI module can make a judgement very quickly, reducing the time from days to mere minutes.

Proving it’s possible

“We had been envisioning something like this for a long period of time,” says Girish Nayak, Chief Customer Service, Operations & Technology, for ICICI Lombard. “We were not really successful working with some start-ups. Therefore, we approached Microsoft to see if we could do this together.”

The two companies started collaborating where software engineers from both companies met and worked on a prototype.

“The prototype gave us confidence that something like this is possible,” said Nayak.

Using the Azure platform, computer vision, and machine learning (ML) technologies, they refined the process until the accuracy was fit for purpose.

The feature was launched in December of 2018 and has worked as expected. Nayak said, “real time renewals of expired policies makes the customer experience consistent and convenient.”

A person self inspecting car insurance through a mobile app

Real time renewals of expired policies makes the customer experience consistent and convenient.

With the app, insurance personnel are more productive as they no longer have to be physically present to inspect vehicles and can focus on less repetitive tasks. With improved efficiency, customer satisfaction has also increased considerably.

According to a new study by IDC Asia/Pacific and Microsoft, “Future Ready Business: Assessing Asia’s Growth Potential Through AI”, organizations in India that have adopted AI have seen tangible improvements of 22% better customer engagement and 21% more productive employees. Further improvements of at least 2.1 times are forecasted over a three-year horizon.

Expanding AI in auto insurance

Renewing policies online has proven to be successful — the company is currently processing between 150 to 200 cars per day — but as Nayak pointed out, using AI for renewals is just a “stepping stone” for the company. AI is a major thrust for the company, and they are very near to using AI to process repair claims as well. The solution is currently in beta stage and is expected to be launched in 2019.

A person clicking snapshot of a car's tyre

AI will soon assess images of damage uploaded by the customer and provide an estimated repair cost within seconds

When a customer’s vehicle is damaged in an accident, they must surrender it to a service center so a service engineer can assess the damage and provide an estimate for repair. Then, an insurance personnel examines both the car and the estimate, and either approves, rejects or modifies individual parts of the estimate.

Compare that to the new, AI-driven process; a customer will use the app to take photographs of car’s damage. Once uploaded, the system’s deep learning model and computer vision identifies in real time all the parts of the vehicle, like roof, window or bumper and then spots all the different types of damage – be it scratch, dent, crack, and so on. Most importantly, the app replies with an estimated cost quickly using historical data.

With AI, the company aims to complete simple claims in days, instead of weeks when the module is launched towards the end of 2019.

Improving customer experience and business outcomes

The advantages to the customer are clear. They can file claims whenever and wherever is convenient and will receive estimates much faster than before.

The app is also valuable to ICICI Lombard from a business perspective. Automating the process reduces the possibility of inaccurate assessments due to human error. And, increased efficiency and productivity improves the bottom line.

A person inspecting damage on the rare end of a car

AI is expected to free up insurance inspectors’ time to focus on complex claims like head on collisions and spend quality time with vehicle owners to help reduce their stress

The role of the human insurance inspectors is changing as well. AI is good at quickly handing the routine claims. That allows insurance inspectors to attend to more complex claims where their experience really matters, like those that involve lot of interior damage, for instance.

Nayak said inspectors are being trained in new skills. “With AI coming in, it frees up their time to prioritize complex cases and personal customer interaction, as well as providing career paths in learning new techniques as well.”

With the launch of the app, the company aims to substantially increase employee productivity and customer satisfaction.

As AI remakes their auto insurance business, ICICI Lombard is keen to employ the technology wherever it aligns with their vision of increasing efficiency and improving customer experience. Currently, they are working towards launching similar AI-powered apps for their health and marine insurance customers.

Posted on Leave a comment

AI Business School launches curriculum for government agencies

More than 140,000 business leaders have immersed themselves in AI Business School since Microsoft introduced the online leadership series two months ago. Now, the school is adding materials designed specifically for government agencies.

The goal: To help government leaders, policy makers and administrators learn more about how technologies infused with artificial intelligence can help their constituents, particularly when it comes to the delivery of important services ranging from applying for a construction permit to getting access to health assistance.

On May 28, AI Business School will launch a new learning path that describes important considerations and potential opportunities for government organizations as they evaluate how AI can help governments become more agile, consistent and efficient, and also better deliver services to their citizens.

“Leaders in the public sector are often faced with unique challenges when considering how to apply AI to improve the speed and quality of the government services they offer their citizens,” says Mitra Azizirad, corporate vice president for Microsoft AI marketing. “The opportunities and scenarios for AI in the public sector are ever increasing, which can make deciding where and how to apply it quite daunting. This is precisely why we expanded Microsoft’s AI Business School to now include a specifically tailored and targeted public sector curriculum to help these leaders address their citizens’ unique needs.”

Anthony Salcito, Microsoft’s vice president for government, said the new government learning path is a win for both government agencies and the constituents they serve.

“Helping governments reach and serve people through cloud services is a key priority for us,” Salcito said. “Citizens want to be able to interact with governments in real time and from any device. AI enables a two-way conversation where citizens can contribute information and receive insights in return.”

“It’s really thinking about 21st century workforce skills,” he added. “The fact is that government workers across the board – and especially decision makers – don’t necessarily have that familiarity or depth on AI. This new learning path is a way to get them introduced to the concept and to understand why it’s important in the context of government work.”

The new content for government leaders will include:

  • A video lecture from Peter Zemsky, Eli Lilly chaired professor of innovation and strategy at INSEAD graduate business school, on why and how governments can identify the right opportunity to use AI.
  • A case study illustrating how the city of Espoo, Finland, is working to modernize life for its residents.
  • A demo showcasing how governments can use intelligent bots to help citizens access resources.

With the assistance of AI, experts say governments can do things like find ways to reduce the time people spend waiting in line for services or find ways to improve public safety.

AI tools also can help government organizations analyze data to find better ways of helping constituents. They also can be used to create intelligent assistants that get people answers to simple questions faster, freeing up government employees to handle more complex requests.

For example, the city of Espoo has been using AI to analyze how its citizens access services, with the goal of figuring out how to serve people more efficiently and effectively. Päivi Sutinen, Espoo’s director of city-as-a-service development, said the experimentation revealed that by using AI and customer data more effectively, they were able to allocate resources more efficiently. That’s helping put the city on a path towards a more sustainable future.

“We launched our experiment because we wanted to find out whether AI can help us target our services proactively,” Sutinen said. “The answer is a strong yes.”

Microsoft says governments of all sizes can benefit from the AI Business School’s new learning path.

“We believe this course is valuable for government decision makers at all levels — from small municipalities to large cities,” said Salcito. “The beauty of artificial intelligence technologies is their scalability.”

Jaime Pereña is a director of AI marketing at Microsoft.

Related:

Posted on Leave a comment

Microsoft releases new book: ‘The Future Computed: AI and Manufacturing’

Today, Microsoft is releasing The Future Computed: AI and Manufacturing. This new book provides an in-depth look at how artificial intelligence (AI) is transforming the manufacturing sector by optimizing digital operations and driving efficiencies, enabling new products and services, and allowing for safer work environments. The book also offers a timely look at how society can respond to some of the challenges AI creates, and the need to develop new laws and regulations to address workforce disruption and develop AI in an ethical and responsible manner.

Written by Greg Shaw – co-author of Hit Refresh with Microsoft CEO Satya Nadella and The Ability Hacks about technology for people with disabilities – this book is the second in a series that began with the release last year of The Future Computed: Artificial Intelligence and its role in society.

In an era when digital technology is changing almost every aspect about how people live, work, play, and learn, we believe it is important to think carefully about the complex questions that AI raises. Through our Future Computed series, we hope to encourage a broad set of conversations about how AI can empower people in a trusted and respectful environment that benefits everyone.

We decided to focus the second Future Computed book on manufacturing because the industry plays such a central role in the global economy, and because, as in previous industrial revolutions, it is once again at the forefront of adopting new transformational technologies.

This means manufacturing is one of the industries that is leading the way in exploring the full potential of AI. It also means manufacturers already find themselves responding to some of the challenges of AI — challenges like how to optimize processes to keep up with the new speed of business, how to ensure their existing and incoming workforce has the right skills to build and leverage AI, and how to create the right organizational culture to realize the benefits of data-driven decision making.

In the book, you’ll hear from a range of customers including ABB, Colfax, Jabil, Tetra Pak, Toyota Materials Handling and ZF about the progress they are making on their AI journey. You’ll meet Patrick Bass, CEO of thyssenkrupp North America, who led the effort to implement a real-time cloud-based predictive maintenance solution that is maximizing uptime for 12 million elevators that move 1 billion people every day. And hear from Manuel Torres, a self-taught engineer who has used AI to transform his paper company into a leading supplier of composite material for airplane manufacturers like Boeing and Airbus.

The Future Computed and Manufacturing book

The book also looks at how manufacturers will need to engage with governments and civil society to help craft new regulatory frameworks, guiding the use of this new technology as the industry transforms. These frameworks should address key societal challenges, including the need to retrain workers to take on new roles and be part of a talent supply chain capable of realizing the potential of AI in manufacturing. They should also address how to store the data generated from connected supply chains and digital factories safely, securely, and in ways that respect privacy and ensure that AI is used ethically. Drawing on insights from customers and policymakers from around the world The Future Computed: AI and Manufacturing offers Microsoft’s perspective on how we might move forward on these important issues.

The Future Computed: AI and Manufacturing does not pretend to have all the answers. But we hope it will play a role in furthering discussions about how to deliver this new technology responsibly and help manufacturers better understand the steps they need to take in their AI journey.

In writing the book, Greg conducted interviews with Microsoft manufacturing customers who are at the forefront of figuring out how AI can drive success for their companies. He also interviewed workforce experts, union leaders, and policymakers from around the world and identified some common themes across these conversations.

The Future Computed: AI and Manufacturing points out the critical importance of cultural change as part of the digital transformation and the need for strong senior leadership in overseeing this shift. It also highlights the way in which the managers inside manufacturing operations who are closest to the workforce are often the most sensitive to AI’s impact on employees and are focused on improving worker safety and job satisfaction. And, while there is notable positivity from leaders in manufacturers around the impact of AI on jobs, there is also an understanding that a lot of work is needed to reinvent how we prepare people for the workforce.

The advent of AI makes this an exciting time to be in manufacturing. But it is also a time filled with great uncertainty. For anyone interested in learning more about why AI is so important to the future of manufacturing, I hope The Future Computed: AI and Manufacturing offers a useful guide. I also love the final remark that suggests leaders of today should lead with optimism.

I encourage you to download a copy here. You can also find out more about the people and companies profiled in the book and access additional information by visiting Microsoft’s AI and Manufacturing website. Additional resources can also be found in the Microsoft AI Business School.

Tags: , ,

Posted on Leave a comment

Building responsible and trustworthy conversational AI

From financial robo-advisors to virtual health assistants, enterprises across every industry are leveraging virtual assistants to create outstanding customer experiences and help employees maximize their time. As artificial intelligence technology continues to advance, virtual assistants will handle more and more mundane and repetitive tasks, freeing people to devote more time and energy to more productive and creative endeavors.

But like any technology, conversational AI can pose a significant risk when it’s developed and deployed improperly or irresponsibly, especially when it’s used to help people navigate information related to employment, finances, physical health, and mental well-being. For enterprises and society to realize the full potential of conversational AI, we believe bots need to be designed to act responsibly and earn user trust.

Last year, to help businesses meet this challenge, we shared 10 guidelines for building responsible conversational AI. Today, we’d like to illustrate how we’ve applied these guidelines in our own organization and share new resources that can help developers in any industry do the same.

Responsible bot guidelines

In November 2018, Lili Cheng, corporate vice president of Microsoft AI and Research, announced guidelines designed to help organizations develop bots that build trust in their services and their brands. We created these bot guidelines based on our own experiences, our research on responsible AI and by listening to our customers and partners. The guidelines are just that — guidelines. They represent the things that we found useful to think about from the very beginning of the design process. They encourage companies and organizations to think about how their bot will interact with people and how to mitigate potential risks. Ultimately, the guidelines are all about trust, because if people don’t trust the technology, they aren’t going to use it.

Designing bots with these guidelines in mind  

The bot guidelines have already started to play a central role in our own internal development processes. For example, our marketing team leveraged the guidelines while creating an AI-based lead qualification assistant that emails potential customers to determine their interest in Microsoft products and solutions. The assistant uses natural language processing to interact with customers, ensuring they receive the information they need or are directed to the Microsoft employee who can best help them. To provide a useful example, we’ve highlighted the ways in which our marketing team has approached three of the guidelines below.

  • Articulate the purpose of your bot and take special care if your bot will support consequential use cases.

Since the assistant would be customer-facing, the marketing team recognized the importance of completely thinking through every aspect of how the bot would work. Before building the lead qualification assistant, they created a vision and scope document that outlined the bot’s expected tasks, technical considerations, expected benefits and end goals in terms of business performance. By outlining these details early in the design process, the team was able to focus on developing and refining only necessary capabilities and deploy the bot sooner. Creating this document also helped them identify and design for edge cases that the bot was likely to encounter and establish a set of effective reliability metrics.

  • Ensure a seamless hand-off to a person where the person-bot exchange leads to interactions that exceed the bot’s competence.

While considering these edge use cases, the marketing team identified a couple of scenarios in which a handoff to a person would be required. First, if the assistant can’t determine the customer’s intent (for example, the response is too complex or lengthy), then the assistant will flag the conversation for a person. The person can then direct the assistant to the next best course of action or respond directly to the customer. The person also can use key phrases from the conversation to train the assistant to respond to similar situations in the future.

Secondly, the customer may ask something that the assistant doesn’t have pre-programmed. For example, a student may request information about our products and solutions but not be interested in making a purchase. The assistant would flag the conversation instead of forwarding it to sales. A person can then reply through the assistant to help the student learn more.

  • Ensure your bot is reliable

To help ensure the bot is performing as designed, the marketing team reviews a set of reliability metrics (such as the accuracy of determining intent or conversation bounce rate) through a regularly updated dashboard. As the team updates and improves the bot, it can closely analyze the impact of each change on the bot’s reliability and make adjustments as necessary.

Helping developers put the guidelines into practice

We have taken lessons learned from experiences like this one and important work from our industry-leading researchers to create actionable and comprehensive learning resources for developers.

As part of our free, online AI School, our Conversational AI learning path enables developers to start building sophisticated conversational AI agents using services such as natural language understanding or speech translation. We have recently added another module, Responsible Conversational AI, to this learning path. It covers how developers can design deeply intelligent bots and also ensure they are built in a responsible and trustworthy manner. In this learning path, developers can explore topics such as bot reliability, accessibility, security and consequential use cases and learn how to mitigate concerns that often arise with conversational AI. We have also created a Conversational AI lab in which a sample bot guides developers through a responsible conversational AI experience and explains its behavior at each point of the experience.

Learn more

We encourage you to share the AI lab and the Responsible Conversational AI learning module with technical decision-makers in your organization.

You can also go to our new AI Business School to learn more about how Microsoft has integrated AI throughout our business and how your organization can do the same.

Related

Posted on Leave a comment

Microsoft and General Assembly launch partnership to close the global AI skills gap

Partnership will upskill and reskill 15,000 workers over the next three years and create industry-recognized credentials for AI skills

REDMOND, Wash. — May 17, 2019 — Microsoft Corp. and global education provider General Assembly (GA) on Friday announced a partnership to close skills gaps in the rapidly growing fields of artificial intelligence (AI), cloud and data engineering, machine learning, data science, and more. This initiative will create standards and credentials for AI skills, upskill and reskill 15,000 workers by 2022, and create a pool of AI talent for the global workforce.

Technologies like AI are creating demand for new worker skills and competencies: According to the World Economic Forum, up to 133 million new roles could be created by 2022 as a result of the new division of labor between humans, machines and algorithms. To address this challenge, Microsoft and GA will power 2,000 job transitions for workers into AI and machine learning roles in year one and will train an additional 13,000 workers with AI-related skills across sectors in the next three years.

“Artificial intelligence is driving the greatest disruption to our global economy since industrialization, and Microsoft is an amazing partner as we develop solutions to empower companies and workers to meet that disruption head on,” said Jake Schwartz, CEO and co-founder of GA. “At its core, GA has always been laser-focused on connecting what companies need to the skills that workers obtain, and we are excited to team up with Microsoft to tackle the AI skills gap.”

The joint program will focus on three core areas: setting the standards for artificial intelligence skills, developing scalable AI training solutions for companies, and creating a sustainable talent pool of workers with AI skills.

  • To create clear and consistent standards for AI skills, Microsoft will be the founding member of GA’s AI Standards Board, and will be joined by other industry-leading companies at the forefront of AI disruption. Over the next six months, the Standards Board will define skills standards, develop assessments, design a career framework, and build an industry-recognized credential for AI skills. Learn more about GA’s Standards Boards here.
  • As businesses adopt AI and machine learning cross-functionally, business leaders and technologists alike must understand AI concepts and master AI tools. Today, Microsoft supports business in aerospace, manufacturing and other sectors with Azure, but many workers are not yet ready to leverage its full capabilities. The collaboration will focus on accelerating the workforce training needs of Microsoft’s customers so that more teams have the foundational skills needed to work with AI.
  • To ensure that businesses can meet ever-growing AI talent needs, GA and Microsoft will establish an AI Talent Network to source candidates for hire and project-based work. GA will leverage its existing network of 22 campuses and the broader Adecco ecosystem to create a repeatable talent pipeline for the AI Talent Network.

“As a technology company committed to driving innovation, we have a responsibility to help workers access the AI training they need to ensure they thrive in the workplace of today and tomorrow,” said Jean-Philippe Courtois, executive vice president and president of Global Sales, Marketing and Operations at Microsoft. “We are thrilled to combine our industry and technical expertise with General Assembly to help close the skills gap and ensure businesses can maximize their potential in our AI-driven economy.”

About General Assembly

General Assembly (GA), an Adecco Group company, closes skills gaps for individuals and companies. Offering training and assessments in software engineering, data science, digital marketing, and more, GA is building clear career pathways for people, and sustainable, diverse talent pipelines for employers. To learn more visit https://generalassemb.ly.

About Microsoft

Microsoft (Nasdaq “MSFT” @microsoft) enables digital transformation for the era of an intelligent cloud and an intelligent edge. Its mission is to empower every person and every organization on the planet to achieve more.

For more information, press only:

Microsoft Media Relations, WE Communications for Microsoft, (425) 638-7777, [email protected] 

Tess VandenDolder, BerlinRosen for General Assembly, (646) 755-6142, [email protected]

Note to editors: For more information, news and perspectives from Microsoft, please visit the Microsoft News Center at http://news.microsoft.com. Web links, telephone numbers and titles were correct at time of publication, but may have changed. For additional assistance, journalists and analysts may contact Microsoft’s Rapid Response Team or other appropriate contacts listed at http://news.microsoft.com/microsoft-public-relations-contacts.

Posted on Leave a comment

Sony and Microsoft to explore strategic partnership

Companies to collaborate on new cloud-based solutions for gaming experiences and AI solutions

Kenichiro Yoshida, President and CEO, Sony Corporation, and Satya Nadella, CEO, Microsoft
Kenichiro Yoshida, President and CEO, Sony Corporation (left), and Satya Nadella, CEO, Microsoft

TOKYO and REDMOND, Wash. — May 16, 2019 — Sony Corporation (Sony) and Microsoft Corp. (Microsoft) announced on Thursday that the two companies will partner on new innovations to enhance customer experiences in their direct-to-consumer entertainment platforms and AI solutions.

Under the memorandum of understanding signed by the parties, the two companies will explore joint development of future cloud solutions in Microsoft Azure to support their respective game and content-streaming services. In addition, the two companies will explore the use of current Microsoft Azure datacenter-based solutions for Sony’s game and content-streaming services. By working together, the companies aim to deliver more enhanced entertainment experiences for their worldwide customers. These efforts will also include building better development platforms for the content creator community.

Sony logoAs part of the memorandum of understanding, Sony and Microsoft will also explore collaboration in the areas of semiconductors and AI. For semiconductors, this includes potential joint development of new intelligent image sensor solutions. By integrating Sony’s cutting-edge image sensors with Microsoft’s Azure AI technology in a hybrid manner across cloud and edge, as well as solutions that leverage Sony’s semiconductors and Microsoft cloud technology, the companies aim to provide enhanced capabilities for enterprise customers. In terms of AI, the parties will explore incorporation of Microsoft’s advanced AI platform and tools in Sony consumer products, to provide highly intuitive and user-friendly AI experiences.

“Sony is a creative entertainment company with a solid foundation of technology. We collaborate closely with a multitude of content creators that capture the imagination of people around the world, and through our cutting-edge technology, we provide the tools to bring their dreams and vision to reality,” said Kenichiro Yoshida, president and CEO of Sony. “PlayStation® itself came about through the integration of creativity and technology. Our mission is to seamlessly evolve this platform as one that continues to deliver the best and most immersive entertainment experiences, together with a cloud environment that ensures the best possible experience, anytime, anywhere. For many years, Microsoft has been a key business partner for us, though of course the two companies have also been competing in some areas. I believe that our joint development of future cloud solutions will contribute greatly to the advancement of interactive content. Additionally, I hope that in the areas of semiconductors and AI, leveraging each company’s cutting-edge technology in a mutually complementary way will lead to the creation of new value for society.”

“Sony has always been a leader in both entertainment and technology, and the collaboration we announced today builds on this history of innovation,” said Satya Nadella, CEO of Microsoft. “Our partnership brings the power of Azure and Azure AI to Sony to deliver new gaming and entertainment experiences for customers.”

Going forward, the two companies will share additional information when available.

About Sony Corporation

Sony Corporation is a creative entertainment company with a solid foundation of technology. From game and network services to music, pictures, electronics, semiconductors and financial services — Sony’s purpose is to fill the world with emotion through the power of creativity and technology. For more information, visit: http://www.sony.net/.

About Microsoft

Microsoft (Nasdaq “MSFT” @microsoft) enables digital transformation for the era of an intelligent cloud and intelligent edge. Its mission is to empower every person and every organization on the planet to achieve more.

For more information, press only:

Microsoft Media Relations, WE Communications for Microsoft, (425) 638-7777, [email protected]

Sony Corporation, Corporate Communications & CSR Department, [email protected]

 

Note to editors: For more information, news and perspectives from Microsoft, please visit the Microsoft News Center at http://news.microsoft.com. Web links, telephone numbers and titles were correct at time of publication, but may have changed. For additional assistance, journalists and analysts may contact Microsoft’s Rapid Response Team or other appropriate contacts listed at http://news.microsoft.com/microsoft-public-relations-contacts.

 

Posted on Leave a comment

Ever-changing music shaped by skies above NYC hotel

Barwick composed five movements within an overall soundscape that reflect the constantly changing nature of the sky throughout the day, each with its own background of bass, synthesizer and vocal lines that weave in and out. For each “event,” identified by Microsoft AI, she then created six synthesized and six vocal sounds for the generative audio program to choose from – for example, 60 different musical options a day for every time an airplane passes above. The sounds are an expression of Barwick’s emotions in response to each stimulus.

“I didn’t want it to be too literal,” she says. “I could have made it sound ‘raindroppy,’ but it’s more about the attitude of the event. An airplane is a lot different than the moon, so it has more of a metallic sound than a warm sun sound or a quiet ‘moony’ kind of feeling. I wanted people who listen to it to be curious and wonder what that sound meant, what’s going across the sky right now.”

Barwick has never been afraid of technology, even if she didn’t have access to it. She recorded her first album in 2007 using a guitar pedal to form vocal loops on a cassette tape. “I didn’t even have a computer then,” she remembers. “I took my bag of tapes in somewhere to get mastered to produce the CD.”

Now she relies on technology to compose, record and perform her multilayered, ambient music. She uses effects on everything, including her voice. There’s no such thing as an unplugged Julianna Barwick set. Still, she says, “Before I was approached to do this project, the only thing I knew about artificial intelligence was from the movies. I’d never seen an application of it in my daily life.”

So as she began exploring sounds, Barwick grappled not only with what AI was and could do, but also with what her role would be in comparison to its. Who was the actual composer – she or the program? Was AI a partner or a tool?

“I contemplated how the project would play out in my absence and realized that I can make all the sounds, but I’m not going to be there to detect all the events — you have to rely on the AI to do that,” Barwick says. “And that’s such an important part of the score; it’s almost like it’s a 50-50 deal. And that’s what makes this project interesting. It almost brings in another collaborator, and the possibilities are endless. It’s opened up a new world of thinking and approaching future compositions and scores.”

a woman composes music on a laptop
A camera sends live images to a Microsoft Azure computer vision tool, which assigns tags such as “clouds” or “sun.” Those are fed into the system that technologists programmed after analyzing Barwick’s compositions and distilling them into an algorithm, which then chooses which tracks to play together.
Posted on Leave a comment

How AI is helping kids bridge language gaps

How did you learn to talk?

Probably something like this: Your infant brain, a hotbed of neurological activity, picked up on your parents’ speech tones and facial expressions. You started to mimic their sounds, interpret their emotions and identify relatives from strangers. And one day, about a year into life, you pointed and started saying a few meaningful words with slobbery glee.

But many children, particularly those diagnosed with autism spectrum disorder, acquire language in different ways. Worldwide, one in 160 children is diagnosed with ASD. In the United States, it is one in 59 children — and approximately 40 percent of this group is non-verbal.

YouTube Video

Learning from superheroes and puppies

Lois Jean Brady and Matthew Guggemos, co-founders of Bay Area-based iTherapy who are speech pathologists and autism specialists, are tackling the growing prevalence of autism-related speech challenges with InnerVoice, an artificial intelligence-powered app whose customizable avatars stimulate social cues. The app animates avatars of superheroes, puppies, stuffed animals and people to help young children who have difficulties with language and expression pair words with meanings and practice conversation.

iTherapy received a Microsoft AI for Accessibility grant in 2018. The program provides grants as well as technology and expertise to individuals, groups and companies passionate about creating tools that make the world more inclusive. iTherapy is using the grant to integrate the Azure AI platform to enhance its generated speech, image recognition and facial animation.

A young boy at the iTherapy clinic uses InnerVoice chat bot to describe his photo of a Teddy bear.A five-year-old student using Zyrobotics to learn to read at Ranch Santa Gertrudes Elementary. 

“I think for sure that the AI component was the missing link,” says Guggemos of the app. “How do you use words, and what do words mean? What does a symbol represent? How do you use AI to develop problems that require language to solve?”

How a hippo helps teach speech 

AI is also proving an exciting development in speech and language improvement for Zyrobotics, an Atlanta-based educational technology company that was the first beneficiary of the AI for Accessibility program in 2018. Zyrobotics is using Azure Machine Learning to help its ReadAble Storiez educational tool interpret when a student needs assistance.

YouTube Video

ReadAble Storiez uses an avatar of a hippo to help students with learning disabilities such as dyslexia and other challenges such as stuttering, pauses and heavy accents.

Ayanna Howard, the company’s founder and professor in robotics, was first motivated to create ReadAble Storiez when watching a teacher use Zyrobotics’ Counting Zoo app with a child. When the teacher turned to her and said, “Can you have this app do more than just read with him? I think it’s fantastic that it helps improve his math – could it also help him improve his reading?”

Howard also found teachers mentioning the challenges of dyslexia in the classroom. “I was like, ‘Oh, what happens if you have a reading disability?’ I then learned that signs of dyslexia in children aren’t picked up until much later, typically when schools start standardized testing. I realized we needed an intervention much earlier and that we could do that with Counting Zoo.”

Learning models that don’t take individualized challenges into account, or don’t address the speech patterns of kids, “tend to fail,” Howard says. ReadAble Storiez employs a custom speech model and a sophisticated “tutor” to convert speech to text and measure accuracy, fluency and the child’s reading improvement.

‘It blew my mind!’

Howard is pleased with the program’s early success. “While they were reading a book, kids were correcting themselves,” she says. “As a technologist, you say your stuff works, but I’m sitting there with the kids and I’m blown away, ‘It really does work!’ It’s thrilling to see that what works in the lab actually works in the real world, in the child’s environment. The [avatar] would provide feedback, and a child would be like, ‘I didn’t say a word right. Can I try again?’ It blew my mind. That was the affirmation. Our solution was on track and on target.”

Brady, who came up with the idea for InnerVoice after studying and writing a book on apps for people with autism, reflects on the impact it has made. She cites an example of working with a student who is non-verbal and used the app to communicate with an avatar of himself.

“He would take a picture of an apple, and an avatar would read it as ‘apple,’ and then he would write it down, ‘apple.’ Until then, I hadn’t even thought of that strategy.”

A mother uses InnerVoice to work on communication skills with her young daughter. A mother uses InnerVoice to work on communication skills with her young daughter.  

Brady and Guggemos imagine the benefits of AI-assisted communication beyond their target audience. They are working with people with dementia, head injuries and strokes. “Many communication apps just talk for you,” Brady adds. “Ours spans many aspects of communication for everybody — even English-language learners. Why wouldn’t I try that? It provides a model. There’s a coffee cup on the table, take a picture of it. How do you say that?”

Howard dreams of Zyrobotics helping to close the gap between mainstream learners and students with learning disabilities. To start, this fall Zyrobotics will introduce ReadAble Storiez to classrooms in the Los Nietos, California, school district, where learning disabilities track high. The company will also apply AI to its suite of STEM Storiez, a series of nine interactive and inclusive books that help children ages 3 to 7 engage with science, math, engineering and technology.

The AI for Accessibility program has been instrumental in getting Zyrobotics off the ground with ReadAble Storiez. “If we hadn’t gotten the grant, we’d be in phase zero,” Howard says. “We run on grants to ensure we provide access to learning technologies for all students. We need to be out there for kids that need us.”

The grant gave Brady and Guggemos the technology to take InnerVoice to the next level. “Our kids need this technology,” Brady says. “It’s not a luxury. We want to keep adding the best stuff. Microsoft really propelled us forward in that arena.”

Top image: A young boy at the iTherapy clinic uses InnerVoice chat bot to describe his photo of a Teddy bear. 

Related: 

Posted on Leave a comment

SK Telecom and Microsoft sign MOU for comprehensive cooperation in cutting-edge ICT

The two companies agreed to combine their strengths to jointly promote IoT business, AI technologies and services, media and entertainment services, and new ways of working

Park Jung Ho, CEO of SK Telecom (left), and Satya Nadella, CEO of Microsoft (right), at a recent meeting.
Park Jung Ho, CEO of SK Telecom (left), and Satya Nadella, CEO of Microsoft (right), at a recent meeting.

SEOUL, KOREA – May 13, 2019 – SK Telecom (NYSE:SKM) and Microsoft Corp. signed a memorandum of understanding (MOU) on May 7 for comprehensive cooperation in leading-edge ICT, including 5G, artificial intelligence (AI) and cloud.

Under the MOU, SK Telecom and Microsoft will combine their technological capabilities in areas such as 5G, AI and cloud to jointly promote Internet of Things (IoT) business including smart factory; AI technologies and services; media and entertainment services; and new ways of working for ICT companies under the SK Group umbrella.

To promote smart factory IoT business operations, the two companies established a business strategic partnership in February 2019 to launch Microsoft Azure with Metatron, SK Telecom’s self-developed big data solution. SK Telecom and Microsoft will work together to further upgrade the service and implement joint marketing activities.

By putting together the capabilities of SK Telecom’s AI platform NUGU with Microsoft’s Cortana digital assistant, the two companies will work together to offer new AI-powered products and services, including consumer solutions such as smart speakers and other offerings for the enterprise.

Moreover, the two companies will work together to create a new level of customer experience in the field of media and entertainment.

SK Telecom will adopt Microsoft 365, the company’s intelligent and secure solution to empower employees, to create a modern workplace and promote a new way of working among employees. Eventually, SK Telecom will expand Microsoft 365 to other ICT companies under the SK Group umbrella. In addition, the two companies will provide new value to customers by combining Microsoft’s modern workplace devices and solutions, such as Surface and Office 365, with SK Telecom’s unique products and services.

“SK Telecom is pleased to join hands with Microsoft as collaboration with global leading companies like Microsoft is essential to gain leadership in the 5G market, where competition is already fierce,” said Park Jung-ho, President and CEO of SK Telecom. “SK Telecom will work closely with Microsoft to create an unprecedented value by combining the strengths and capabilities of the two companies.”

“Through the strategic partnership with SK Telecom, we will play a key role in shaping the future and accelerating the digital transformation of the telecommunications industry with our world-class network and technology,” said Jason Zander, executive vice president, Azure, Microsoft. “This will be a deep and multifaceted partnership that strengthens the power of cloud and AI to deliver innovative new services to customers.”

About Microsoft

Microsoft (Nasdaq “MSFT” @microsoft) enables digital transformation for the era of an intelligent cloud and an intelligent edge. Its mission is to empower every person and every organization on the planet to achieve more.

About SK Telecom

SK Telecom is the largest mobile operator in Korea with nearly 50 percent of the market share. As the pioneer of all generations of mobile networks, the company has commercialized the fifth generation (5G) network on December 1, 2018 and announced the first 5G smartphone subscribers on April 3, 2019. With its world’s best 5G, SK Telecom is set to realize the Age of Hyper-Innovation by transforming the way customers work, live and play.

Building on its strength in mobile services, the company is also creating unprecedented value in diverse ICT-related markets including media, security and commerce.

For more information, press only:

SK Telecom Public Relations/Media Contact, [email protected] or [email protected]

Microsoft Media Relations, WE Communications for Microsoft, (425) 638-7777, [email protected]

Posted on Leave a comment

A Microsoft employee’s personal and global impact on rare disease

Adult hugging childAdult hugging child

The summer of 2009 was a nightmare for my family. Our 3-month-old son Sergio was ill, and doctors could not diagnose his condition. Our family went on a long journey to find an answer. Two years after his symptoms began, in 2011, we learned that he had Dravet Syndrome.

Neurologists were working to find a diagnosis and Sergio was being treated while they searched. At nine months of age, he was given a drug that was contraindicated for what ultimately was his condition. Soon after receiving it, he started to have dozens of seizures per day.  We stop counting the seizures, and wondered why, in the age of computers, neurologists don’t use computers and data to improve the diagnosis process.

This event changed my life. I founded the Dravet Syndrome Foundation in Spain in 2011 after learning of Sergio’s condition, and later, Foundation 29. I spent seven years trying to find a cure. Unfortunately, finding a cure for a rare disease is very challenging. Instead, using resources available to me as a Microsoft employee, and with foundation volunteers, created a diagnostic program for children with Dravet Syndrome, called Dx29. To date, it has provided diagnoses for more than 700 patients worldwide. It is now available for clinicians to use free of charge.

The Long Wait for a Rare Disease Diagnosis

Patients live an average of 4.8 years for a rare disease diagnosis. In the meantime, they contend with the risk of medical errors and severe side effects.  Patients visit an average of 7.3 specialists, with 40% of patients reporting that a delayed diagnosis had a significant or very marked impact on their condition. It is estimated that 6-8% of the world is affected by a rare disease, meaning that improvements in diagnosis procedures could impact 460-620 million people.

The Need for Clinical Data Integration

The conventional diagnosis process is not designed for the complex biology behind rare diseases. It usually starts with a clinical consultation. A physician requests a genomic test, sending along the biological samples and the symptoms (phenotypes) already identified. The sequencing is performed and bioinformaticians (often manually) analyze the large amount of data produced. To carry out this complex analysis, they use the symptoms identified by the physician to guide their search.

The physician’s and bioinformation’s data are not integrated, so these professionals are disconnected. Those conducting the gene filtering have partial phenotypic information but are unable to collect more data because only physicians have full access to patients and their records. The genetic report the physician receives would likely be different if more patient information was available during gene filtering. Clinical decisions made based on the genetic data could be different with more data. How can bioinformaticians check if a given gene variant in the patient is producing a concrete phenotype? How is the patient information put in the hands of bioinformaticians? There is an information gap issue.

Satya Nadella Empowers Employees to Help

At the 2017 Microsoft employee hackathon in Spain, one of my best friends, and Microsoft colleague, Sacha Arozarena, suggested we create a bot to diagnose patients with rare diseases. After just three days of intensive work, our prototype was able to suggest symptoms and navigate the user to a potential diagnosis. It was still a proof of concept, but we won the Spanish hackathon. The most important achievement of this work was the connections the prototype created for us.

That same month, I heard Satya Nadella discuss his son’s medical condition while he presented at Microsoft Ready, so I sent him an email asking for help. He replied within five minutes, connecting me with Microsoft’s Research team. Through this connection, I learned about Microsoft’s efforts in several areas:  a new Genomics team, a team working on medical natural language processing, and the company’s investments and efforts towards bringing artificial intelligence to health science.

Using the Cloud and AI to Speed Diagnosis

One year ago, colleagues and I founded Foundation 29, a non-profit organization with the mission to improve the lives of patients with rare diseases through faster, better diagnosis. The foundation is developing solutions to facilitate diagnosis, with the intention of distributing them to every physician in the world. Dx29 is the name of this effort. The goal is to reimagine and democratize diagnosis.

The tool we developed uses Artificial Intelligence (AI) to close the information gap. The gene filtering of most routine low-level cases can be automated with AI, allowing bioinformaticians and specialists to focus on the most challenging cases where human intervention is required. Physicians can drive automatic genetic analysis simply by identifying symptoms in the tool. The physician’s role comes back to the center of the process, focusing on the patient and doing symptom identification and differential diagnosis.

Dx29 does not make a diagnosis, but enhances the physicians’ skills. It gives physicians a tool that augments their capabilities by hiding the complexity of genomics and allowing them to focus on clinical diagnosis, something they are already experts on.

The process starts by performing automatic symptom identification and codification from medical records. It then allows physicians to navigate the complexity of gene identification by simply selecting identified symptoms in the tool.  In the final step, once enough symptoms have been matched with the genetic information, Dx29 presents a ranked list of potential conditions for the physician to further evaluate and decide how to proceed. The foundation did the first medical tests last December with promising results. Our goal is to make the tool available to the medical community this spring and find a business model to secure the continuity of the project.

Thanks to Microsoft and Global Organizations

Dx29 is possible because of help from Microsoft and its employees. It is impossible to list all Microsoft employees who joined forces to collaborate on this initiative. Foundation 29 and in particular, Dx29 are honored by the privilege of working with Microsoft software engineers, product groups, and consultants. Architects from Microsoft Services, data engineers, data scientists and the legal department provided us with advice on privacy and data protection.

I am proud to work for a company that empowers employees to achieve more. A lack of diagnosis is not only a stressful situation for patients and families, but also for healthcare professionals. Without a diagnosis, an appropriate treatment is not possible. With all the help received so far, Foundation 29 aims to empower physicians with the right tool to provide an accurate diagnosis.

I would like to thank the following organizations for their contributions to the development of the Dx29 tool and its pilot:

  • Centro de Investigación Biomédica en red de Enfermedades Raras (CIBERER), Madrid, Spain
  • Hospital La Paz de Madrid, Madrid, Spain
  • NIMGenetics, Madrid, Spain,
  • Idibell, Barcelona, Spain
  • The Global Commission on Rare Diseases

Rare disease patients are exceptions in clinical routines, but they drive the medical community towards precision medicine. Precision medicine should not be limited to exceptional cases, but spread to all patients, improving the standard of care for all.

Time is ticking. I know I won’t be able to find a cure for Sergio and he will have to live with Dravet Syndrome all his life. But having the possibility of creating a tool to speed up and improve diagnosis process for other children is a strong motivation for me, my family and the community around us. Helping others is sometimes the only way to heal your own wounds.

Learn more about Dx29, the Global Commission and how AI can support diagnosis and read more from the Microsoft In Health Blog on the Global Commission.