OpenSceneGraph Forum Forum Index OpenSceneGraph Forum
Official forum which mirrors the existent OSG mailing lists. Messages posted here are forwarded to the mailing list and vice versa.
 
   FAQFAQ    SearchSearch    MemberlistMemberlist    RulesRules    UsergroupsUsergroups    RegisterRegister 
 Mail2Forum SettingsMail2Forum Settings  ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 
   AlbumAlbum  OpenSceneGraph IRC ChatOpenSceneGraph IRC Chat   SmartFeedSmartFeed 

sign language avatar with osg


 
Post new topic   Reply to topic    OpenSceneGraph Forum Forum Index -> General
View previous topic :: View next topic  
Author Message
Trajce Nikolov NICK
Guest





PostPosted: Sun Mar 11, 2018 8:22 pm    Post subject:
sign language avatar with osg
Reply with quote

Hello Community,

I carry this idea with me from my UNI days (which is about 20 years ago) and since recent it was just an idea. Over time it was even close to get some funding but it did not happen.


The idea is to have virtual 3D avatar that can "speak" the sign language based on text or voice input. The recent technology from Google made the realization of  the language translation doable.


So I am here to ask you if someone might be interested in actually make this happen. I personally work with an artist (friend of mine, decades of friendship, also worked together on various projects). And we want to do this opensource, based on OSG.


All suggestions, brainstorms, hints, anything, are highly welcome!


Cheers,
Nick

--
trajce nikolov nick

------------------
Post generated by Mail2Forum
Back to top
Jan Ciger
Guest





PostPosted: Mon Mar 12, 2018 9:10 am    Post subject:
sign language avatar with osg
Reply with quote

On Sun, Mar 11, 2018 at 9:18 PM, Trajce Nikolov NICK < (
Only registered users can see emails on this board!
Get registred or enter the forums!
)> wrote:
Quote:
Hello Community,

I carry this idea with me from my UNI days (which is about 20 years ago) and since recent it was just an idea. Over time it was even close to get some funding but it did not happen.


The idea is to have virtual 3D avatar that can "speak" the sign language based on text or voice input. The recent technology from Google made the realization of  the language translation doable.


So I am here to ask you if someone might be interested in actually make this happen. I personally work with an artist (friend of mine, decades of friendship, also worked together on various projects). And we want to do this opensource, based on OSG.


All suggestions, brainstorms, hints, anything, are highly welcome!


Cheers,
Nick

--
trajce nikolov nick




_______________________________________________
osg-users mailing list
(
Only registered users can see emails on this board!
Get registred or enter the forums!
)
http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org





Hello,


Before you commit significant time into this, do some state of the art research. This topic has been done quite a few times before, including attempts at the automatic translation:
https://www.google.fr/search?q=sign+language+virtual+human


If your goal is to bring a product to the market, there is a lot of material there to get you started. If it is for research purposes, then you are going to have tough time bringing some new ideas there.



Regards,


Jan

------------------
Post generated by Mail2Forum
Back to top
Richard Kennaway
Guest





PostPosted: Mon Mar 12, 2018 11:36 am    Post subject:
sign language avatar with osg
Reply with quote

On Sun, March 11, 2018 8:18 pm, Trajce Nikolov NICK wrote:
Quote:
Hello Community,


I carry this idea with me from my UNI days (which is about 20 years ago)
and since recent it was just an idea. Over time it was even close to get
some funding but it did not happen.

The idea is to have virtual 3D avatar that can "speak" the sign language
based on text or voice input. The recent technology from Google made the
realization of the language translation doable.

So I am here to ask you if someone might be interested in actually make
this happen. I personally work with an artist (friend of mine, decades of
friendship, also worked together on various projects). And we want to do
this opensource, based on OSG.

All suggestions, brainstorms, hints, anything, are highly welcome!

I did some work on signing avatars 10 to 20 years ago, in an academic
context. In fact, several of the first page of hits for the Google search
that Jan Ciger posted refer to that project (Virtual Humans at UEA).

My own role in that was to create software to turn signing transcriptions
written in an avatar-independent notation into animation data for driving
any humanoid avatar, in real time. Feel free to email me for more
information if this sounds relevant to what you have in mind. My
publications on this can be found through ResearchGate or Google Scholar.
As Jan says, there has been a large amount of work on this, by other
groups as well, although it seems to me that none of it has really taken
off. Perhaps because it is a very niche application. The demand would be
primarily from the pre-lingually deaf, i.e., those for whom signing is
their first language. With all respect to that population, it is a very
small one.

Personally, I would be more interested in extending my work to do
procedural animation of more general sorts of movement, but I've haven't
done anything substantial on that.

--
Richard Kennaway
John Innes Centre and University of East Anglia
Norwich, U.K.



------------------
Post generated by Mail2Forum
Back to top
Trajce Nikolov NICK
Guest





PostPosted: Fri Mar 16, 2018 1:10 pm    Post subject:
sign language avatar with osg
Reply with quote

Thanks Richard, Jan,

indeed, there is a lot of research to be done for this. I have done some consultancy in of the the CS UNI in Macedonia with teachers who tried this in the past so there are already some insights. I would see the first simple app on mobile device, something like an app that will teach the sign alphabet only ... For real translator it will take some time. And thanks again Richard, I will ping you for sure on this...


Cheers and thanks
Nick


On Mon, Mar 12, 2018 at 12:32 PM, Richard Kennaway < (
Only registered users can see emails on this board!
Get registred or enter the forums!
)> wrote:
Quote:
On Sun, March 11, 2018 8:18 pm, Trajce Nikolov NICK wrote:
Quote:
Hello Community,


I carry this idea with me from my UNI days (which is about 20 years ago)
and since recent it was just an idea. Over time it was even close to get
some funding but it did not happen.

The idea is to have virtual 3D avatar that can "speak" the sign language
based on text or voice input. The recent technology from Google made the
realization of  the language translation doable.

So I am here to ask you if someone might be interested in actually make
this happen. I personally work with an artist (friend of mine, decades of
friendship, also worked together on various projects). And we want to do
this opensource, based on OSG.

All suggestions, brainstorms, hints, anything, are highly welcome!

I did some work on signing avatars 10 to 20 years ago, in an academic
context. In fact, several of the first page of hits for the Google search
that Jan Ciger posted refer to that project (Virtual Humans at UEA).

My own role in that was to create software to turn signing transcriptions
written in an avatar-independent notation into animation data for driving
any humanoid avatar, in real time. Feel free to email me for more
information if this sounds relevant to what you have in mind. My
publications on this can be found through ResearchGate or Google Scholar.
As Jan says, there has been a large amount of work on this, by other
groups as well, although it seems to me that none of it has really taken
off. Perhaps because it is a very niche application. The demand would be
primarily from the pre-lingually deaf, i.e., those for whom signing is
their first language. With all respect to that population, it is a very
small one.

Personally, I would be more interested in extending my work to do
procedural animation of more general sorts of movement, but I've haven't
done anything substantial on that.

--
Richard Kennaway
John Innes Centre and University of East Anglia
Norwich, U.K.

_______________________________________________
osg-users mailing list
(
Only registered users can see emails on this board!
Get registred or enter the forums!
)
http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org






--
trajce nikolov nick

------------------
Post generated by Mail2Forum
Back to top
Display posts from previous:   
Post new topic   Reply to topic    OpenSceneGraph Forum Forum Index -> General All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum

Similar Topics
Topic Author Forum Replies Posted
No new posts avatar animation cleo General 1 Fri Sep 26, 2014 5:46 pm View latest post
No new posts 答复: C# language invoke OSG function 龚来恩 General 0 Mon Jun 30, 2014 1:05 am View latest post
No new posts C# language invoke OSG function 龚来恩 General 1 Thu Jun 19, 2014 6:11 am View latest post
No new posts truning OSG into OpenGL language kim jong bum General 1 Wed Dec 18, 2013 5:35 am View latest post
No new posts fixes for building osg with c++11 lan... jan.klimke Submission 1 Sun Oct 20, 2013 6:49 pm View latest post


Board Security Anti Bot Question MOD - phpBB MOD against Spam Bots
Powered by phpBB © 2001, 2005 phpBB Group
Protected by Anti-Spam ACP