Have audio transcription separated out by person, and properly formatted | Voters

Have audio transcription separated out by person, and properly formatted

planned

Zack Baddorf

Right now the audio transcription text that comes back is a mess. It's hard to know who said what and I don't derive any value from the blurb but I keep it in case I need to go back to reference it.
So, I recommend developing the transcription AI so that it can recognize voices and separate out Person 1 vs Person 2 vs Person 3. 
Then, I recommend having it formatted to something like:
Person 1: blah
Person 2: blah
Person 1: blah
Person 3: blah

April 4, 2024

alex appelbe

In addition to this request, and as probably much lower-hanging-fruit, there are other voice transcription elements that could be really useful.

Visual notification that indicates that my voice note is being processed ok (before the text shows up). I get scared that the voice note has dissappeared and that the thought will be lost, until i see it show up as text eventually.
Timestamp of when the voice memo was recorded. If i recoed multiple voice notes in a day on Reflect, it would be great for them to be labelled in my Reflect timeline based on time.
On mobile, when i want to process the voice transcript with Reflect AI, i think i have to highlight all the text i want to process. This is painful. It would be amazing if i could just click a checkbox on the voice memo(s) which i want to process with AI, and then all the text in that voice tranzcription segment woiuld be automatically highlighted,

To give a bit more context, in case helpful, I'm an alpha tester of Cleft Notes and MacWhisper, which are both fantastic voice transcription tools which i use every day.

MacWhisper for transcribing meetings and longer notes, and processing them with LLM prompts (eg. summarising, extracting statistics etc).
Cleft I use for transcribing and summarising personal voice notes and it's amazing for this (It's not designed for long-form, multi-person meetings).

I see

Reflect audio transcription

as being more akin to Cleft, than MacWhisper (for now). What i mean by that is that i find Reflect really great for taking personal voice memo's, on the go. And then processing them with the Reflect AI prompts to tidy them up, when i get a few minutes to spare.

Even if Reflect audio was amazing I would still see myself using Cleft, and MacWhisper AS WELL, as i think each of them serves different purposes (for now) and i think voice memo based workflows are the future! (and we don't need Humane Pin or Rabbit to enable this future)

Alex MacCaw

marked this post as

planned

This is called 'diarization' and we plan to make it.

Mike Brevoort

Alex MacCaw this would be so great in combination with the AI integration.

Here's a janky workflow that I use multiple times per week:

Record an important meeting using Quicktime + Blackhole
Use a little python script to pass audio to Deepgram to transcript with diarization
Open in VS Code, select each speaker and replace all "Speaker x" with real names
Upload to Claude and ask very specific questions about the conversation, not just summarization but for specific details, coaching in certain situations, etc.
I take some of the output of that and save it in Reflect under the meeting.

If you could make that workflow seamless in Reflect, I would love you even more :)

sam c

Merged in a post:

AI Meeting Transcription

Louie

I love this app and it would be extraordinary if ai had the ability to transcribe full meetings, analyze and provide summaries, action items, etc.

April 23, 2024

Sergio

Even with this you’d need to sit there and work out who person 1 and person 2 is. Really you need the full integration int whatever video conferencing you’re using and that’s very unlikely to happen.

Ma San

I have a template that formats the audio transcript after it's been processed, but that's indeed suboptimal. It would be prefable if we can use our own transcription script

Barbara

An easy first step is to use Zapier to import the meeting summaries + associated hyperlinks to the recorded meetings. This is provided by services like Fathom.video, Otter.ai, or Zoom. Fathom has performed the best for me so far.

Mark

Since Zoom does meeting AI summaries now, a good first step for this one would be to integrate with the Zoom AI meeting summaries.

Don Ho

If you're looking for companies that are doing meeting summaries the right way - by far the best, most comprehensive summaries are by Bloks (www.bloks.app). Too bad I hate their UI and their notetaking capabilities are trash compared to Reflect.

Alex Libre

Don Ho: oh very cool. I currently use Krisp.ai and then just paste the transcript summaries into Reflect, but I'm gonna give Bloks a try.