View topic - Integrating Multi-touch Input into Spring



All times are UTC + 1 hour


Post new topic Reply to topic  [ 20 posts ] 
Author Message
PostPosted: 05 Oct 2011, 00:50 

Joined: 12 Apr 2011, 09:00
Hi All,
I'm working on integrating multi-touch input into the engine. I have a thread at http://springrts.com/phpbb/viewtopic.php?f=12&t=25865that hasn't been updated in a while. Anyway, I've been talking to abma about integrating the code, the fork that I was working on is at https://github.com/bilhamil/spring. At the time I created a branch based on the 0.82 branch so that I knew I was working with something stable.

Right now I'm planning on cleaning up what I did at the time (I did a lot of hacky stuff to make working on my personal project easier). Basically what would be enabled would be passing multi-touch cursor events into lua. Currently I'm just using tuio to receive touch events, which is a cross-platform protocol based on osc for getting touch events from multi-touch sensors.

Is there interest in integrating this into the engine? If so, what would be the best approach going forward? What concerns do the devs have? Should I make a feature branch based on the current development branch? I appreciate the help.


Top
 Offline Profile  
 
PostPosted: 05 Oct 2011, 15:08 
Cursed Zero-K Developer
User avatar

Joined: 07 Nov 2007, 21:48
Location: Horse
I noticed in your youtube video you used the "pinch" motion to "tilt" the camera (changing the pitch of the map). I would recommend that when you integrate with spring that you follow the model used by the android maps app:

Pinch to zoom.
Two-finger-drag to tilt.


Top
 Offline Profile  
 
PostPosted: 05 Oct 2011, 15:13 
Content Developer
User avatar

Joined: 13 Jan 2005, 00:46
Location: ModalitÃ
wow, you are still working on that stuff? very cool man!


Top
 Offline Profile  
 
PostPosted: 06 Oct 2011, 02:58 
Moderator
User avatar

Joined: 23 Nov 2005, 06:16
Location: Dunedin, New Zealand
Holy shit this is a real thing? Nice.


Top
 Offline Profile  
 
PostPosted: 06 Oct 2011, 06:14 
Zero-K Developer
User avatar

Joined: 10 Sep 2008, 02:11
Location: In search for TheTruth (TM)
Your stuff is awesome!
Of course we want multi-touch! :-)

...no idea where we could get ahold of multitouch HIDs, though.


Top
 Offline Profile  
 
PostPosted: 06 Oct 2011, 06:26 
User avatar

Joined: 19 May 2007, 08:28
Location: YOU WILL REGRET THIS
MidKnight wrote:
...no idea where we could get ahold of multitouch HIDs, though.

Make one yourself?


Top
 Offline Profile  
 
PostPosted: 07 Oct 2011, 00:15 

Joined: 12 Apr 2011, 09:00
One of my colleagues actually develops sensors that you can just put on top of regular displays http://ecologylab.net/research/zerotouch/index.html. They're pretty affordable, although he hasn't really ramped up production yet. Hopefully, that will happen soon.


Top
 Offline Profile  
 
PostPosted: 07 Oct 2011, 09:38 
Moderator
User avatar

Joined: 26 Oct 2007, 15:21
Wow, that demo video features spring! Really nice stuff!


Top
 Offline Profile  
 
PostPosted: 14 Nov 2011, 22:12 

Joined: 03 Jul 2011, 10:54
A multitouch desktop display is actually my next upgrade, spring with a proper tuned touch-ui would be something special.

:shock:

me gusta.


Top
 Offline Profile  
 
PostPosted: 14 Nov 2011, 22:52 
Map Creator
User avatar

Joined: 23 Jan 2008, 18:29
Found this from suggestions:
http://www.youtube.com/watch?v=wyZrrkwM ... re=related


Top
 Offline Profile  
 
PostPosted: 14 Nov 2011, 23:08 
Zero-K Developer
User avatar

Joined: 10 Sep 2008, 02:11
Location: In search for TheTruth (TM)
SirArtturi wrote:

Use forum search. :-)

EDIT: Actually, I can't find the the thread with that video either using forum search. :s


Top
 Offline Profile  
 
PostPosted: 15 Nov 2011, 00:15 
Map Creator
User avatar

Joined: 23 Jan 2008, 18:29
Ah yes, a bit hasty post. Didn't bother to visit every urls in this thread.

So yeah, doubled, better...


Top
 Offline Profile  
 
PostPosted: 17 Mar 2012, 03:36 

Joined: 17 Sep 2008, 03:36
Location: your imagination
Dead? No way!

http://www.youtube.com/watch?v=XbkM8jlhW9Y


Top
 Online Profile  
 
PostPosted: 03 Apr 2012, 07:03 

Joined: 03 Jul 2011, 10:54
Awesome!

I think what we need is a stable multitouch API, so the other devs can make their adjustments as they please. And this should be integrated into the engine as soon as possible.

Can you imagine spring being one of the first RTSs to support multitouch out-of-the-box and it being 100% configurable just via LUA? That sounds sweet to my ears, and by the looks of it, it is not far away.

Keep up the good work! I REALLY appreciate it, touchscreen displays is the way of the future, we only need to figure out the best way to interact with them!


Top
 Offline Profile  
 
PostPosted: 30 May 2012, 23:28 

Joined: 12 Apr 2011, 09:00
Voidness and I have been working on a lua sockets widget that acts as a TUIO listener for touch events. Basically it opens up a udp socket, parses incoming osc messages, interprets the tuio and generates widget events for touches.

I've attached the listener itself along with some of the widgets we have been using for doing touch interaction if anyone wants to try it out. A lot of it is built off of modified versions of widgets in Zero-K, so I'm not sure how readily the widgets may be added to other games.

Hoping to work on doing Windows 8 touch event integration later this summer (there are a lot of problems with win 7 touch), but this should work with a lot of touch sensors that use win 7 touch using a bridging application like: http://dm.tzi.de/touch2tuio/


Attachments:
File comment: tuio touch listener widget and associated interaction widgets
Lua_TUIO_Touch.zip [2.38 MiB]
Downloaded 41 times
Top
 Offline Profile  
 
PostPosted: 31 May 2012, 09:16 
Server Owner & Developer
User avatar

Joined: 19 May 2006, 18:13
Location: Brno, Czech rep., EU, Terra, Sol, Orion arm, Milky way, Virgo supercluster
Very nice, we could integrate this to ZK itself and the sender to Zero-K lobby if its some sort of open source/CC common license


Top
 Offline Profile  
 
PostPosted: 31 May 2012, 16:55 
Spring Developer

Joined: 31 May 2009, 23:08
awww,.... awesome! :D

what to do with the touchdev branch then? :-/


Top
 Offline Profile  
 
PostPosted: 01 Jun 2012, 00:10 

Joined: 12 Apr 2011, 09:00
Like I said earlier I think there would be value in having a windows touch solution at some point, which would have to be done in the engine. That would probably use a significant portion of the code already in touchdev.

btw luasockets was a really great addition to spring imo :)


Top
 Offline Profile  
 
PostPosted: 02 Aug 2012, 17:32 

Joined: 20 Mar 2008, 11:02
Really awesome. With this new form of user input the interface and way the game is played will diffidently look and work completely different totally different. I see this being most useful in large scale attacks. With the amount of input we can have since we are not limited to just one cursor. we can divide and reorganize, and redirect many more units at a time. For Example, now having a fleet of 20 bombers coming across the screen, with only seconds to divide them between targets might be extremely effective.

The most successful part of implementing extremely effective group management will probably be a transition in scale of focus.

Really really cool potential!

Springs game play potential was unmatched as it is but now it could give even more scale and control to a user. WOW.


Top
 Offline Profile  
 
PostPosted: 07 Sep 2012, 09:56 
Spring Developer

Joined: 31 May 2009, 23:08
@bilhamil:

any efforts to integrate the lua-thing into zero-k? i've enabled luasocket as default and listening to a socket is also allowed as default.

see https://github.com/spring/spring/commit ... 3d024e118b

is that enough to make it work out of the box?


Top
 Offline Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 20 posts ] 

All times are UTC + 1 hour


Who is online

Users browsing this forum: No registered users and 0 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB® Forum Software © phpBB Group

Site layout created by Roflcopter et al.