Skip to content

Jitsi voice transcription to text / Enhancement or do we already have an option to enable it from a Jitsi room ? #344

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
ClaudeStabile opened this issue May 23, 2021 · 17 comments
Assignees
Labels
enhancement New feature or request

Comments

@ClaudeStabile
Copy link
Contributor

Is there a way to enable transcription on some specific room only. Or better to enable it after joining a jitsi room. And option within the console would also be a great feature.
Currently if my understanding is correct, if we enable transcrption this is done and activated for all Jitsi conf on the OF server. There is a button to disable it within the conf but ideally i would like to have the contrary, enable transcriptions on the Fly
This is a very expected feature as we can transcribe only slice of conferences or whatever we want.

screenshot3

@gjaekel
Copy link
Contributor

gjaekel commented May 23, 2021

I also discovered this recenty, and the same holds for "Display Message as Captions": There's no difference between enabling the feature and the initial state - if the feature is enabled, its switchable by the user. But the initial state is also enabled.

I also suggest to have a second option with the initial state.

@gjaekel gjaekel added the enhancement New feature or request label May 23, 2021
@gjaekel gjaekel self-assigned this May 23, 2021
@ClaudeStabile
Copy link
Contributor Author

@gjaekel Initial state could be great. If we can switch on and off from the Jitsi room, it would be a great enhancement. If we can toggle it on with a special shortcut even greater. You may also need to enable language chooser so transcribing from language you are speaking in that room. ++ Thanks a lot in adv for taking the point

@gjaekel
Copy link
Contributor

gjaekel commented May 23, 2021

You already may switch both features via the Conference Captions Dialog.

I already add Hotkeys and a Message Autohide, compare to Issue #299/PR #336 and #341

@deleolajide
Copy link
Member

Is there a way to enable transcription on some specific room only.

At the moment, not yet. However If you install the rawproperties plugin,
image

You can add new properties to each MUC room
image

Pade can then look for a property called ofmeet.voice transcription and enable transcription if the value is true

@ClaudeStabile
Copy link
Contributor Author

ClaudeStabile commented May 23, 2021

@gjaekel

I tried this hint.
I have created a room named voice2text on my server https://www.free-solutions.org/Voice2Text and added property as suggested
but still no transcription. No emmergency i was just trying out, i am always curious.

screenshot4

If you can add option within the Jitsi room it will be a huge steps ahead :)

@deleolajide
Copy link
Member

You can now apply interface_config properties to specific rooms by adding them as MUC room properties.
For example, to enable transcriptions, set OFMEET_ENABLE_TRANSCRIPTION to true.

image

@gjaekel
Copy link
Contributor

gjaekel commented May 24, 2021

You can now apply interface_config properties to specific rooms by adding them as MUC room properties.

.. in a generic way, i.e. any properties to any room. Is this expandable to the config properties, too?

@gjaekel
Copy link
Contributor

gjaekel commented May 24, 2021

But in spite of that, I should going to add a second configurable properity for the initial state - something like startWithCaptionsEnabled and startWithTranscriptionEnabled, right?

@deleolajide
Copy link
Member

Is this expandable to the config properties, too?

Only working with OFMEET interface_config properties. It will require more work to use config. You would have to test to see how it behaves for Jitsi properties. I think it will be too late to take effect.

@gjaekel
Copy link
Contributor

gjaekel commented May 24, 2021

It's a smart new thing, anyway! It will allow to setup rooms with different characteristics.

@ClaudeStabile
Copy link
Contributor Author

Congrats @deleolajide for this already a big step ahead :)

I will try this out on one of my server. That's really cool as it open new possibility to differentiate room behaviour.
thanks a lot also @gjaekel for pusshing this and interest

++ Thanks a lot for efforts

@ClaudeStabile
Copy link
Contributor Author

@deleolajide @gjaekel
I have installed & compiled latest Padé. I have created a permanent room named voice2text with these variables and IT WORKS !!!
https://www.free-solutions.org/voice2text all other rooms are without transcription !!! YES !!!
That's really a nice addon as we can define some apecific rooms where speach is transcribed
That's already an immense step ++ Congrat to both of you for this hack :)

@gjaekel
Copy link
Contributor

gjaekel commented May 25, 2021

@ClaudeStabile: Delé have merged in the GUI changes (Meet Client and Admin UI) at #345 some minutes before; you may also have a look at this as soon the snapshot has been build.

@ClaudeStabile
Copy link
Contributor Author

@gjaekel @deleolajide i did a mvn compile & mv package from Github Repo. I am also testing with android, it looks better, menu bar looks perfect now. So issue #329 is closed for me.
You can try out on https://www.free-solutions.org with android. I will probably build another package(i did it at 5PM), let me know when it make sense. I have tried out room params, works fine, nice addon ! My site is free so it is always a good way to validate and have a quick return with these new features and it benefit to the whole OF community. Thx a lot for pushing this !

@ClaudeStabile
Copy link
Contributor Author

@deleolajide

I did not manage to make this work again. Is there a possible regression in 1.7.1 ?

Thx

@deleolajide
Copy link
Member

I did not manage to make this work again. Is there a possible regression in 1.7.1 ?

Yes. It is now fixed in 1.7.2

@ClaudeStabile
Copy link
Contributor Author

That's super cool @deleolajide thanks i will try out again Thanks !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants