xvasynth posts
Posts: 74
Files: 463
Interim batch (14 voices); Second community voice actor model; xVATrainer nearing completion; Hardware upgrade
A fair bit to update on! Let's get into it.First of all, I've been going through more v1->v2 voice re-training. The 13 re-trained voices are (all Skyrim):- Serana- FemaleCondescending- MaleBrute- MaleYoungEager- Frea- MaleEvenTonedAccented- MaleDrunk- Galmar- Esbern- Tulius- Ulfric- Kodlak Whitemane- ArngeirI w...
Interim voices (5); First community voice actor model
So the strawpoll in the last post apparently doesn't work (fab), but I got another poll going on the discord server, and the vote was overwhelmingly (17 for, 6 against) in favour of doing more voice re-training v1->v2, rather than a new set of voices. The re-training is underway for a good number of voices, but a c...
Fuz Ro Bork integration! ; Meta-poll #2
This one's been a long time coming, but it's finally here (and finished).This is an xVASynth plugin to integrate xVASynth voices into the Fuz Ro Bork mod which adds real-time TTS to the player in Skyrim. This has been a joint effort with the FuzRoBork author to get it to work. Check the video out to see it in a...
Batch #34 - 6 (5+1 bonus) new voices; xVASynth now public on Steam
The next voices are here!Had a slight set-back. While integrating the training script into xVATrainer, I found some ways to optimize the training scripts, which also affects the quality (I think for the better - let me know!). This meant a few days of (necessary) re-calibration, but the scripts are now faster, which sh...
Interim batch of 12 voices re-trained to v2
While the poll was going, I spent some gpu time re-training some of the other older v1 voices over to v2, in addition to the ones mentioned in the last post. With this update, we're now at about 20% of the voices having been re-trained to v2. The training scripts are getting faster and faster, with every optimizati...
1 year anniversary of v1.0 | xVASynth on Steam!
Well, it's now been an entire year since I first posted the initial full release of the app, on 11th Jan 2021!Things have come a long way for xVASynth, from its early days in 2018 (YouTube showcase of v0.1). Since this time last year, we've reached: Over 450 voices trained (not including re-trained models) Supp...
Batch #33 - 6.5 new voices
Some new voices from the last poll are here, along with some further v1->v2 re-trained voices.I actually included one more voice from the poll that didn't win, because I had already trained it before the poll ratings changed order, right at the end. The voices are as follows:- Skyrim: Florentius- Fallout New Vegas:...
Interim 11 (4 new and 7 v2 re-trained) voices;
I hope everyone's having a great holiday.I've been taking it a little easier on the voice training, and focused a bit more on re-training some main voices from v1 to v2. I've included them here, as well as some new voices.The new voices:- GTA Vice City: Colonel - GTA Vice City: Diaz- GTA Vice City: Lance- A...
Batch #32 - 7 new voices; +1 game
This batch is now ready! Aside from the private requests, the winning voices are:- Cyberpunk: Rogue- Fallout New Vegas: FemaleOld03- Dragon Age: Flemeth- Dragon Age: Greagoir- Dragon Age: Russel DorseyFrom requests, we also have:- Cyberpunk: River (aka Sobchak)- GTA Vice City: TommyThis introduces app support for GTA V...
Batch #31 - 5.5 new voices
The next lot of voices is here (with some v2 re-training of older voices on the way). The winning voices this time are:- Fallout 4: Travis- Fallout 3: Moira- Fallout New Vegas: Ulysses- Dragon Age: Ser Gilmore- Fallout 76: MortNow, for the Travis voice, if you've played Fallout 4 you might know, there are two stage...
Interim batch, 6 voices; +1 game; Hardware upgrade
I've been going through some requests (of which one was private), as well as some v1 re-training to v2 models. The voices:- Fallout 76: GenericSettler03- (v2 re-trained) Skyrim: FemaleCommander- (v2 re-trained) Skyrim: MaleNord- (v2 re-trained) Fallout 4: MrGutsy- (v2 re-trained) Cyberpunk: Johnny- Star Wars Jedi F...
Technical post #? - New AI dataset pre-processing tools
I spent some time recently, putting together and finalising a series of new tools for data preparation/pre-processing. These are tools that I've already finished integrating into xVATrainer (which is how I use them now!), so I thought I'd quickly cover them here.Some of these heavily build on top of the previou...
Batch #30 - 10 voices; Fallout 4 : Alternative Player Voices; +1 new game
The voices from the first v2 poll is here! This covers the top voted voices from Poll #30, one of the requested voices, and some re-trained v1 voices. The list:- Skyrim: Brynjolf- Skyrim: Hadvar- Fallout 3: Harkness- Baldur's Gate: Narrator (BG3)- Mass Effect: Kelly- (requested) Fallout 76: MaleGenericSettler02Re-t...
xVASynth v2.0.0!
After several months of development, v2.0 of xVASynth is now finally live! The update is now live on the Nexus (Skyrim already, the rest are also coming today, I'm working my way through the slow uploads).Also releasing today is the initial release of the xVADict community project, for the Elder Scrolls words. This...
More v2.0 models; Public v2.0 release date; xVATrainer
The training scripts have been whirring away, and I've actually gotten them to be faster and more high quality still, with some further work.I've been working through some base voices to use as pre-training, in future voices, as well as some voices for use in the v2.0 showcase video (which is now finished). The...
Progress update; Another v2.0 voice
Just wanted to make a quick post to update people with what's going on at the moment.I've been hard at work optimizing the training scripts, and I think I've now got it as good as it's going to get for now. It's definitely faster, now, which is great, but still slower than the v1.0 training script, ...
Batch #29 - 13 (5+8 bonus) new voices; Meta-poll #1
The next round of voices is here, with the winning 5 voices from the poll, as well as a bunch from requests. The poll voices are:- Mass Effect: Jack- Fallout New Vegas: FemaleOld01- Fallout New Vegas: FemaleOld02- Fallout New Vegas: MaleAdult09- Fallout 3: ElderLyonsAnd the voices from requests are:- Mass Effect: Morin...
v2.0 pre-release; Success with v2 FastPitch models
Here we go - v2.0 is here! And after a long time trying, so is the new training script for the v2.0 models, using the new and improved FastPitch architecture!v2.0 is a huge update, with lots of things I've been wanting to add for quite some time, so I'm super excited to get this out.I'll say a bit about the...
Interim batch (6 voices); 2 new games; v2 release date; xVASynth + Skyrim Real Time Player TTS mod
Got a few things, for this post. Let's start with some new voices, to come from requests:- Borderlands: Tyreen- Mass Effect: Samara- Persona: Ren- Persona: Morgana- Persona: Kasumi- Portal: GLaDOSThese now introduce two new game series: Persona, and Portal! Please remember to install the asset files for these, if y...
Batch #28 - 15 (6+9 bonus) new voices; +1 game; 400+ voices! ; short break to prepare release
The next batch is here! A fairly big one, as there was a spike in requests (one of which private). The voices from the poll are:- Fallout 3: MaleAdult06- Fallout 3: Butch- Cyberpunk: Rhino- Cyberpunk: Kerry- Borderlands: Claptrap- Borderlands: JackThe voices from the public requests are:- Fallout3/4/New Vegas/76: Narra...
Batch #27 - 10 (7+3 bonus) new voices; more v2.0 progress
A few more voices are now finished, from requests and the previous poll:- Skyrim: Adril- Skyrim: Galmar- Fallout New Vegas: FemaleAdult01Default- Fallout New Vegas: MaleAdult08- Fallout New Vegas: Veronica- Fallout New Vegas: Mr. House- Cyberpunk: Sebastian- Dragon Age: Sten- Dragon Age: Wynne[EDIT] Also, I forgot: - T...
Batch #26 - 7 (6+1 bonus) new voices; +1 game
The votes are in, and the voices are done! The winning poll choices are:- Skyrim: Dexion- Fallout New Vegas: Dean- Fallout New Vegas: MaleOld01- Fallout 3: FemaleAdult01Default- Borderlands: Lilith- Borderlands: BrickI also did a voice I myself personally wanted, for Humankind, the new 4x game, just because I tried it ...
Poll #26 - Pick your top 3 choices
We're nearing the end of the Skyrim voice list, with most/all of the remaining ones being voices from previous polls which did not get picked.If you've missed it, I've also updated some of the existing Skyrim voices to have Tacotron2 pre-training and HiFi models:- FemaleDarkElfCommoner- MaleSoldier - Female...
Batch #25 - 16 (6 + 10 bonus) voices ready; 3 new games
[EDIT 23/10/2021]: The team fortress 2 voices are really not that good at the moment, but I think I can greatly improve them with the v2.0 models. I will make another pass on them soon.Another big round, having finished off more voices from a spike in requests, and the poll. This time covering an additional 3 newly sup...
Overwatch extravaganza! 30 new voices interim batch
Got a big batch of requested voices, covering all the voices from the Overwatch game (apart from bastion, which is just robot beeps). The Overwatch voices were for some reason really quick to train (maybe shorter lines?), so I got through them comparatively quite quickly.So the list is:- Ana- Ashe- Baptiste- Brigitte- ...
Batch #24 - 16 (7+9 bonus) voices ready
A big one this time. I had a spike in requests, so I've been quite busy!As I do more and more voices, I keep finding myself learning new things about the games I thought I knew well. I never knew that for GTA:SA, the main character (CJ) actually has a different voice (acted differently, same voice actor), for when ...
Changes to the Patreon structure
Hi everyone, I just wanted to make a quick announcement post regarding some changes to the Patreon structure.The next big update for the app will be a big one. In fact, I re-wrote the majority of the app, and there are enough big new features that I think it's time we move up to v2.0!I didn't want to reveal any...
Batch #23 - 9 (7+2 bonus) voices ready; Over 300 voices!
More voices dropping:- Skyrim: Modyn- Skyrim: Elenwen- Skyrim: FemaleVampire- Skyrim: Fura- Fallout New Vegas: MaleAdult06- Fallout New Vegas: MaleAdult07- Fallout New Vegas: FemaleGenericGhoulThere are also two extra voices included, from requests:- Skyrim: Astrid- Skyrim: ValericaThese two voices replace the old Astr...
Batch #22 - 7 new voices; Brief break, to focus on s2s
The latest poll is now ready. This includes the following voices:- Skyrim: Delvin- Skyrim: MaleVampire- Skyrim: Nazir- Skyrim: Odahviing- Fallout 3: FemaleOld01- Cyberpunk: Misty- Cyberpunk: PlacideThe next poll will follow very soon. I do however have some time off from work this coming week, so I will aim to spend it...
(very) Technical post - Representation learning of speakers
Ok, this post will go a little deeper than the others. I've been working on something else, in the background, called representation learning. This actually very closely aligns with what I actually do day-to-day as part of my PhD, so it's been quite a bit of fun.What representation learning isRepresentation lea...
