MIDI kit as accessibility tools—music to my ears

I am a failed musician. Actually, it’s a bit rich to call myself a ‘musician’ at all, let alone a failed one. No, I’m more of the type who knows a handful of chords and knows that if I record enough times and jab at those keys enough times, I might eventually end up with something that passes for music that you can actually listen to. Or as someone once said: throw enough darts, and eventually you win a fish.

One of the side effects of this propensity for hammering keys and pads in the vain hope that it may result in something creative is that you can be easily tempted by hardware that will ‘unleash your inner musician’. What it actually does, though, is create a pile of technology that serves as little more than a testament to your failed musical dreams:

Collection of MIDI instruments

But it’s not all bad news. In recent times, I’ve come to realize that these buttons and pads can be quite easily put to other uses in my day-to-day work auditing web sites for accessibility.

Testing tools and scripts: what’s your poison?

We all have our favorite tools that we run for testing web page features, whether that’s browser extensions, bookmarklets or favelets, or copy and pasting bespoke scripts into the console; whatever works for you, that’s great (as long as you know that automated tools will only get you so far).

To try to make sense of the various tools and scripts that I find myself using day in and day out, I turned to an app called Keyboard Maestro. It’s a macOS app that lets you run all manner of macros and which, I’ll admit, can be somewhat overwhelming when you first play around with it. I have described it to people as a Swiss Army knife of possibilities, and many people will likely just use a couple of blades and never use that pokey thing that is, I gather, for removing stones from horses’ hooves or something. Whatever. Don’t be afraid of its possibilities for now I’m going to tell you how I use it for my daily work alongside some grim reminders of my ineptitude as a musician some music hardware that I fortuitously had kicking around.

Among the many things that Keyboard Maestro can do is to run scripts in a browser. At the time of writing, this is limited to Google Chrome and Safari because Firefox has no AppleScript support, and for this to work, you first need to give each browser permission to accept Apple events:

In Chrome choose: View → Developer → Allow JavaScript from Apple Events
Allowing Apple events in Google Chrome
In Safari choose: Develop → Allow JavaScript from Apple Events
In Safari, allow Apple Events from the Develop menu (note that this must be enabled in Safari Preferences: General > Show Develop menu in menu bar)

By doing this, you can then run arbitrary scripts from Keyboard Maestro, either scripts that you enter into a field in Keyboard Maestro or scripts that you reference in Keyboard Maestro through an external script file. This is similar to the concept of running a bookmarklet (or favelet as some prefer to call them) but with the advantage that you aren’t limited by cross-site scripting limitations that usually prevent bookmarklets from referencing an external JavaScript file. So you can reference a script file locally that you can easily update. But that’s not really the killer thing here—what’s great about this is that, unlike a bookmarklet where you have to activate that bookmark in the browser, by moving it to Keyboard Maestro, you can then assign a whole raft of possible triggers that can activate that script, including time-based triggers (run at a specific time), network-change triggers (such as when you change Wi-Fi networks), menu-selection triggers or, what’s most useful here, keyboard triggers. So you can set a keyboard shortcut to trigger a script. To give one example, I have a script that lets me find form inputs that don’t have autocomplete attributes and then provides some help about what attribute values may be useful. To trigger it, I can press CTRL + Option + Command + A and it will work in Chrome or Safari. Here is the Keyboard Maestro macro:

Keyboard Maestro macro to run a locally hosted JavaScript file in the browser

Dusting down the hardware

Pretty soon you can end up with a whole raft of keyboard shortcuts to remember, and some may not be ideal as you try to avoid using shortcuts that conflict with an app’s predefined keyboard shortcuts. Before you know it, you may have to do mental gymnastics to remember which particular combination of modifier keys you need to press. And this is where my poor musicianship and my inability to resist buying music hardware that was, of course, a much-needed purchase at the time, come into play. Take this, for example:

Korg nanoPAD

It’s a Korg nanoPAD. Twelve velocity-sensitive pads and a trackpad-type thing that can be used for filtering and modulation in music setups. I previously used it with DJing software to trigger cue points and so on. But with Keyboard Maestro, I can set macros to be triggered by connected MIDI devices. Very quickly I can assign a script or action to a note on a MIDI device or, in this case, a button:

Keyboard Maestro macro set to be triggered by a MIDI note

You can set up a macro that does a number of steps, not just run a single script like the one above. For example, here’s one where I send exactly the right amount of page-zoom commands and window-resize operations to test SC 1.4.4 Resize Text in the browser:

Multiple page zoom commands sent to the browser and window resize sets up the page for 1.4.4 Resize Text testing

So now, when I look at this Korg device that’s sitting just above my QWERTY keyboard, I see it more like this:

Korg nanoPAD with annotations for multiple buttons indicating that they trigger browser scripts or set up the browser for specific WCAG tests

What’s more, while I have these actions configured for Chrome (primarily), I can also set per-application actions so that this device with lots of big fat buttons can be used to trigger all manner of other actions.

So if you just happen to fit in the Venn diagram overlap of ex- (or wannabe) musicians, incurable music-hardware purchaser, Mac user, and accessibility professional—I know, it’s a niche area—then it may be worth dusting down some of that old kit to see whether you can repurpose it for another use. If you’re not a Mac user, I dare say that there are equivalent apps that do the same kind of thing on Windows, but I leave that up to you to investigate. In the meantime, I just realized I have this old thing kicking around and I’m wondering what nefarious plans to unleash with it. Just look at all those buttons!

An Ableton LaunchPad MIDI controller - an 80-button controller that could be used to control all manner of events through Keyboard Maestro or similar apps

Categories: Development
Tags: , ,

About Ian Lloyd

Ian Lloyd (or 'Lloydi' as he prefers) is a Principal Accessibility Engineer at TPGi. He joined the company in 2020 and previously worked for Apple as an accessibility engineer. Prior to that, he spent what seems like a lifetime working for a financial services company, trying to promote accessibility with varying levels of success. In an alternate universe, he continued his early path of DJ-ing and producing to become a superstar DJ, but this universe had other ideas. Outside of work, he maintains a11y-tools ("A random collection of accessibility-focused tools that you might find at least partially useful").

Comments

Del Burton says:

Interesting ideas, but most of it went over my head as I’m neither a Mac user or musician of any description. I would be interested to see if some enterprising individual could repurpose a StreamDeck or even a number pad to do the same thing.

Ian Lloyd says:

Del, that Stream Deck looks interesting. I like the fact that each button is customisable (as a mini screen). I don’t know if that would work with the software I mention above, but I suspect it could. Also … are you trying to make me buy more things with buttons? 😀