Ö÷²¥´óÐã

Singing With Machines: Making Music and Sound Art with 'Smart Speakers'

R&D has been collaborating with musicians and artists to discover how 'smart speaker' devices could offer new ways of creating, enjoying and sharing music and sound art.

Published: 27 June 2018
  • Tim Cowlishaw

    Tim Cowlishaw

    Senior Software Engineer

In June, and I had the amazing opportunity to show some of our work at , the technology and creativity conference attached to the in Barcelona. This was a great opportunity for us to show our work at a venue very different to the places we usually present at, and to gather feedback from a very diverse audience.

Sonar Festival has been running for 25 years, and is a major event in Barcelona’s cultural calendar. Split over two sites and three days, it attracts performers and festival-goers from around the world, and showcases some of the most exciting new music being produced today.  Sonar+D has been running alongside it for the last five years, offering a forum for collaboration between artists, businesses, and research institutions investigating and imagining the future of creativity.  We were privileged to be invited to give a talk on the work of Ö÷²¥´óÐã R&D’s Internet Research and Future Services section, and also to deliver a version of our ‘Singing with Machines’ workshop, teaching musicians and sound artists to use ‘smart speaker’ devices in new and imaginative ways.

Our talk centred around the role of creativity in our work - how, in the service of our mission to imagine the Ö÷²¥´óÐã services of the five-to-ten year future, we use a strategy of ‘operationalised weirdness’ to imagine and prototype as diverse a set of possible futures as possible and respond to them in an innovative manner.  This impacts the things we make the way in which we make them, and the people we make them with. More specifically, we focus on ‘half resolution’ prototypes (and often physical objects rather than on-screen prototypes) which express a single idea or feature as fully as possible, rather than striving for completeness in terms of functionality. We find that this allows us both to explore the possibilities afforded by the technologies we’re working with more comprehensively, and to produce prototypes which help us elicit specific, actionable feedback on the ideas we’re testing from the widest variety of people.  

The people we work with to achieve this are also key to our approach.  By working participatively with a great variety of potential users or collaborators (and focusing specifically on diversity and on examining use cases which might currently be considered to be edge-cases or ‘outliers’), we are able to imagine future use cases and opportunities which might otherwise have gone unexamined. 

One great example of this is our â€˜Singing with Machines’ project, which was the focus of our second session at Sonar. A spin-off of our work, which aims to investigate new experiences using ‘smart speaker’ devices such as the and , ‘Singing with Machines’ is concerned specifically with how these devices can be used for new ways of creating, enjoying, and disseminating music and sound art.  We’ve been working collaboratively with musicians and sound artists to explore this, most notably our recent workshop with , ,  and , as well as a collaboration with  and , two students on Queen Mary University’s  PhD programme.

This work has two main purposes. Firstly, we believe that smart speakers provide an exciting platform for innovative and accessible new musical experiences, through their connectedness, growing ubiquity, comparative low cost, reasonable sound quality and opportunities for interaction. The Ö÷²¥´óÐã has been at the forefront of innovation in sound and music since the Radiophonic Workshop, so we hope to continue this tradition in some small way with our present work. Secondly, we believe that this work has more far-reaching positive effects on our other projects using smart-speaker devices; in particular, more creative and speculative work such as this can act as a  of the technologies and platforms on which these devices operate, giving us insights into how they work, which can be more generally useful.   

At Sonar, we condensed our findings from our work to date into a three-hour workshop for sound artists and musicians; introducing them to the technologies and tools used to create interactive voice experiences, and allowing them to explore how these devices could be used within their own practice. It was great to present our approach to a lively and creative community of people with whom we’d previously been unfamiliar.  Participants came away enthused and informed about this new technology, and generated lots of interesting, creative ideas for uses of this technology that we hadn’t anticipated - allowing us to broaden our own exploration of the possibilities of the medium.  We have gained many new ideas and opportunities for future work and collaboration, for ‘Singing With Machines’ and other projects, and we look forward to sharing these developments with you in the near future!

 

  • Internet Research and Future Services section

    The Internet Research and Future Services section is an interdisciplinary team of researchers, technologists, designers, and data scientists who carry out original research to solve problems for the Ö÷²¥´óÐã. Our work focuses on the intersection of audience needs and public service values, with digital media and machine learning. We develop research insights, prototypes and systems using experimental approaches and emerging technologies.

Rebuild Page

The page will automatically reload. You may need to reload again if the build takes longer than expected.

Useful links

Theme toggler

Select a theme and theme mode and click "Load theme" to load in your theme combination.

Theme:
Theme Mode: