Skip to content

Commit 5a904de

Browse files
authored
Merge pull request #67 from microsoft/JWR-Transcript-Demo-Update
Jwr transcript demo update
2 parents 82a1e73 + 567db54 commit 5a904de

8 files changed

+1252
-792
lines changed
Binary file not shown.
Binary file not shown.
Binary file not shown.

demos/transcript-demo-power+azure/developer-guide.md

Lines changed: 1206 additions & 768 deletions
Large diffs are not rendered by default.
Lines changed: 31 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,11 @@
11
# Installation Guide
2-
There are two versions of the solution: managed and unmanaged. We **strongly** recommend you use the managed version if importing into an existing environment with other solutions. If you want to customize the solution, you can use the unmanaged version or you can import that managed version and use an unmanaged solution to store your customiations.
2+
3+
## Word Template
4+
Before you setup the solution, you must first load the Word template into a SharePoint document libray. You'll need to know the SharePoint site before importing the solution.
5+
6+
## Import Solution
7+
8+
There are two versions of the solution: managed and unmanaged. We **strongly** recommend you use the managed version if importing into an existing environment with other solutions. If you want to customize the solution, you can use the unmanaged version or you can import that managed version and use an unmanaged solution to store your customizations.
39

410
Which ever version you use, the steps are basically the same:
511

@@ -8,32 +14,41 @@ Which ever version you use, the steps are basically the same:
814
3. Click **Import Solution**
915
4. Click **Browse** and select the file (managed or unmanaged)
1016
5. Click **Next**
11-
6. You will be prompted to update the connections. If none exist, you will need to create them.
12-
![image](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/ba369542-a53c-4ee3-a64f-28eb82500351)
17+
6. You will be prompted to update the connections. If none exist, you will need to create them.
18+
![Screenshot of Power Apps Import a solution form](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/58f375fe-b9b8-412c-b682-49ef2d724554)
1319

14-
7. When setting up the Azure Blob Storage connection, please set the follow parameters
15-
![image](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/d2d558ca-c3d6-4c4c-8f89-3519d198b1e2)
20+
8. When setting up the Azure Blob Storage connection, please set the follow parameters
21+
![Screenshot of the Azure Blob Storge connection configuration prompt](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/d2d558ca-c3d6-4c4c-8f89-3519d198b1e2)
1622

1723
- **Authentication type**: Access Key (Azure Government)
1824
- **Azure Storage account name or blob endpoint**: Azure storage account name
1925
- **Azure Storage Account Access Key**: Azure atorage acount access key
2026
8. After configuring all connections there should be a green check box next to each one
21-
![image](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/37ba1855-70d1-45e5-b93b-514526188e00)
27+
![Screenshot of the connections authenticated successfully](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/ad0d5703-6adc-4bbd-8464-616cc5a1b3fe)
28+
2229
9. Click **Next**
2330
10. You will then be prompted to update the environment variables:
24-
![image](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/3a1d53c3-8de9-4b21-9d38-7a0fb2197eb5)
25-
- **Speech to Text Region**: The Azure location/region used by the Azure Batch Speech to Text services
26-
- **Speech to Text Key**: The key for the Azure Batch Speech to Text service
27-
- **SharePoint Site**: The site where the SharePoint list is located
28-
- **SharePoint List**: SharePoint list used to temporarily store the audio file as an attachment
29-
- **Azure Blob Destination SAS URL**: The SAS URL for the container the the transcripts go into. _Note: this SAS URL must be configured for anonymous access and have write/create priviledges._
30-
11. Click **Import**
31+
![Screenshot of environment variables](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/449875e2-5a36-4e97-9f12-bd2b204fb47e)
32+
33+
- **Azure Speech to Text Region**: The Azure location/region used by the Azure Batch Speech to Text services
34+
- **Azure Speech to Text Key**: The key for the Azure Batch Speech to Text service
35+
- **Azure Blob Storage Source Container**: Path to the container that will receive the audio files
36+
- **Azure Blob Destination SAS URL**: The SAS URL for the container the the transcripts go into. <br>_Note: this SAS URL must be configured for anonymous access and have write/create priviledges._
37+
- **SharePoint Site**: The site where the Word document template is located
38+
- **Web API Endpoint**: For Databverse Web API calls
39+
40+
12. Click **Import**
3141

3242
The import process takes a few minutes.
3343

34-
You may get an warning:
35-
![image](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/b6e3caaa-875a-49e0-b78c-6c18c5af9aa9)
36-
If you do, you will need to go into the solution and turn on the parent flow (02 - Azure - When Audio File Created in Blob Storage - Create Transcript). This bug may be addressed in further releases.
44+
## Update Flow with Word Template
45+
46+
Due to limitations with the Word connector, you must hard code the Word template into the [PA - Create Transcript Document](developer-guide.md#pa---create-transcript-document) flow
47+
Edit the flow and update the **Document Library** and **File** parameters
48+
49+
![image](https://github.com/user-attachments/assets/ac2bedd1-fe3d-485c-96dc-327607a69c52)
3750

51+
[▲ Top](#installation-guide)
3852

53+
[← Back to Read Me](readme.md)
3954

demos/transcript-demo-power+azure/readme.md

Lines changed: 15 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,7 @@
11
# Overview
2-
This demo is designed to illustrate the "better together" story of Azure + Power Platform. The demo includes a canvas app that allows users to upload an audio file (MP3 or WAV) and then transcribe the audio and then edit the transcription (e.g. to fix discrepancies). Under the "hood", the solution leverages Power Automate flows to connect to Azure Blob Storage and Azure Speech Services to store and transcribe the audio respectively. The final output is then stored in Dataverse.
2+
This demo is designed to illustrate the "better together" story of Azure + Power Platform. The demo includes a canvas app that allows users to upload an audio file and then transcribe the audio and then edit the transcription (e.g. to fix discrepancies). Under the "hood", the solution leverages Power Automate flows to connect to Azure Blob Storage and Azure Speech Services to store and transcribe the audio respectively. The final output is then stored in Dataverse.
33

4-
5-
![canvas app - main screen](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/45514b7e-ab60-4daa-95a6-cd227f1a45f0)
4+
![canvas app - main screen](https://github.com/microsoft/Federal-Business-Applications/assets/12347531/80570fa5-7517-4e8c-8ece-fad400505d01)
65

76
# Contents
87
- [Release Notes](#release-notes)
@@ -20,6 +19,7 @@ This demo is designed to illustrate the "better together" story of Azure + Power
2019
| Version | Release Date | Change Log |
2120
| :------ | :---------- | :--------- |
2221
| 1.0.1.0 | 3/21/2024 | - |
22+
| 1.0.2.24 | 7/11/2024 | - Added GPT generated transcript summary (requires Generative AI enabled in environment) <br> - Added downloadable PDF transcript <br> - Removed SharePoint list dependency. App now uploades directly to Azure Blob Storage <br> - Other minor changes to UI/UX|
2323

2424
## Supported Clouds
2525
This demo was built in a GCC-High tenant. If you are using a GCC tenant, note that you will need an Azure Gov subscription to connect directly to [Azure Blob Storage](https://powerautomate.microsoft.com/en-us/connectors/details/shared_azureblob/azure-blob-storage/) and [Azure Speech to Text](https://powerautomate.microsoft.com/en-us/connectors/details/shared_cognitiveservicesspe/azure-batch-speech-to-text/) from Power Apps and Power Automate via the out of the box (OOTB) connectors. There is a workaround described [here](https://github.com/microsoft/Federal-Business-Applications/wiki/PowerApps-Connecting-from-GCC-to-any-Endpoint-including-Commercial-Azure).
@@ -33,7 +33,8 @@ You must have the following to use this solution:
3333
3. [Azure Storage Account](https://learn.microsoft.com/en-us/azure/storage/common/storage-account-overview)
3434
4. **Two** [Azure Blob Storage Containers](https://learn.microsoft.com/en-us/azure/storage/blobs/storage-blobs-introduction) (source for audio and destination for transcripts)
3535
5. [Azure Batch Speech to Text](https://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-transcription) key
36-
6. SharePoint List with attachments enabled
36+
6. [Generative AI Features enabled](https://github.com/microsoft/Federal-Business-Applications/blob/main/whitepapers/copilot/README.md#phase-1-opt-in-with-azure-commercial-azure-openai)
37+
7. SharePoint Site & Document Library
3738

3839
[^ Top](#contents)
3940

@@ -42,29 +43,35 @@ You must have the following to use this solution:
4243
- Demo Transcript App (Canvas)
4344
- Demo Transcript Admin App (Model Driven)
4445
- Flows
45-
- 01 - SPO - When Audio File Uploaded to SPO - Copy to Azure Blob
46-
- 02 - Azure - When Audio File Created in Blob Storage - Create Transcript
46+
- 01 - Power Apps - Upload to Azure Blob
47+
- 02 - Azure - Create Transcript
4748
- 02b Child Flow - Loop Until Transcript is Complete
4849
- 02c Child Flow - Get Transcript Results
4950
- 02d Child Flow - Parse Transcript and Load into a Dataverse
51+
- 02e Child Flow - Summarize Transcript
52+
- PA - Create Transcript Document
5053
- Tables
5154
- Transcripts
5255
- Recogonized Phrases
53-
- Transcript
56+
- Speakers
5457
- Environment Variables - *Note: these will need to be updated on import*
5558
- SharePoint Site
56-
- SharePoint List
5759
- Speech to Text Key
5860
- Speech to Text Region
5961
- Azure Blob Destination SAS URL
6062
- *note: this requires a SAS URI be generated and the container must allow for anonmyous access. Additional info, and other more secure methods are described [here](https://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-transcription-create?pivots=rest-api#specify-a-destination-container-url)*
63+
- Web API Endpoint
64+
- Azure Blob Storage Source Container
6165
- Web Resources
6266
- Icons for each table
6367
- Connection References - *Note: these will need to be updated on import*
68+
- Approvals
6469
- Azure Batch Speech to Text
6570
- Azure Blob Storage
6671
- Microsoft Dataverse
6772
- SharePoint
73+
- One Drive for Business
74+
- Word Online (Business)
6875

6976
[^ Top](#contents)
7077

0 commit comments

Comments
 (0)