Automated Infolog uploading

Automated Infolog uploading

Discuss the source code and development of Spring Engine in general from a technical point of view. Patches go here too.

Moderator: Moderators

Post Reply
User avatar
koshi
Lobby Developer
Posts: 1059
Joined: 14 Aug 2007, 16:15

Automated Infolog uploading

Post by koshi »

I've started on a server side python application that will accept uploads: http://github.com/springlobby/spring-infolog

Someone else (Beherith?) please do the infolog parsing in http://github.com/springlobby/spring-in ... backend.py (with the appropriate Table model).

Then we can talk views of the collected data: http://github.com/springlobby/spring-in ... loglist.py / http://github.com/springlobby/spring-in ... /list.html
User avatar
koshi
Lobby Developer
Posts: 1059
Joined: 14 Aug 2007, 16:15

Re: Automated Infolog uploading

Post by koshi »

Turns out I was/am already prepared to upload a lot more on the SL side: unitsync.log, spring settings, ext.txt and script.
User avatar
hoijui
Former Engine Dev
Posts: 4344
Joined: 22 Sep 2007, 09:51

Re: Automated Infolog uploading

Post by hoijui »

the most useful for devs would probably be, if we could use basic unix tools to crawl through the data: find, grep, sed, awk
so we could get a list of all GFX cards-driver combinations that crashed in the gfx driver, and compare to average appearance rate of the cards in logs.
is it possible to get a comparable level of freedom through a web interface?
User avatar
koshi
Lobby Developer
Posts: 1059
Joined: 14 Aug 2007, 16:15

Re: Automated Infolog uploading

Post by koshi »

it's a python app, you can do whatever you want to with the uploaded zip
User avatar
hoijui
Former Engine Dev
Posts: 4344
Joined: 22 Sep 2007, 09:51

Re: Automated Infolog uploading

Post by hoijui »

so i will be able to go to the site, and put something like system("find bli bla | sed ta da") somewhere, and get the result?
or is it more like.. i have to write the whole thing in pure python, then ask someone with admin rights on the server to include this code there, and then i will be able to call it through a web interface?
User avatar
koshi
Lobby Developer
Posts: 1059
Joined: 14 Aug 2007, 16:15

Re: Automated Infolog uploading

Post by koshi »

If someone would be stupid enough to allow entering system commands, sure you would ;-)
The idea was to have predefined processing of the data and store that in a db backend.
The uploaded zip could be stored alongside so you can download it and do your own processing on it ofc.
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: Automated Infolog uploading

Post by Licho »

Springdownloader already uploads infolog to separated CA service existing for some years.

I will also send it there.
Where can i upload new data?
Or its not done yet?
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: Automated Infolog uploading

Post by Licho »

Btw it would be great to have it mod filtered and also allow to search for lua errors.
We are using infologs to check rare lua bugs.
User avatar
koshi
Lobby Developer
Posts: 1059
Joined: 14 Aug 2007, 16:15

Re: Automated Infolog uploading

Post by koshi »

It's not done yet, so feature set ain't done yet either.
I am looking for someone to do the actual infolog parsing and db model, so anything's possible atm really.
User avatar
zwzsg
Kernel Panic Co-Developer
Posts: 7052
Joined: 16 Nov 2004, 13:08

Re: Automated Infolog uploading

Post by zwzsg »

What about privacy concerns?
User avatar
koshi
Lobby Developer
Posts: 1059
Joined: 14 Aug 2007, 16:15

Re: Automated Infolog uploading

Post by koshi »

Not a matter of the receiver, on the SL side this is opt in.
Pako
Posts: 174
Joined: 12 Jul 2009, 18:57

Re: Automated Infolog uploading

Post by Pako »

I would like to see all my(and others) Lua errors somewhere. Sometimes the game is just too intense to fix bugs right away and it's usually forgotten after the game. I already have countless forgotten bugs to fix.
User avatar
koshi
Lobby Developer
Posts: 1059
Joined: 14 Aug 2007, 16:15

Re: Automated Infolog uploading

Post by koshi »

I'm planning to make a SL release by the end of the weekend with upload capability enabled. Therefore I'll need at least the barebones (which would only accept uploads and list them) version of this app running by then.
If no one wants to run it on the springrts box make something like infologs.springrts.com point to my box.
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: Automated Infolog uploading

Post by Licho »

So where it is installed and how does it work, how can i send infolog?
Can I send desyncs too?
Can I send demos as well somewhere?
User avatar
koshi
Lobby Developer
Posts: 1059
Joined: 14 Aug 2007, 16:15

Re: Automated Infolog uploading

Post by koshi »

It expects a zip like this as input.
You can use http://infologs.springzine.net/upload as a reference.
Url is still subject to change.
User avatar
Zydox
Lobby Developer
Posts: 453
Joined: 23 May 2006, 13:54

Re: Automated Infolog uploading

Post by Zydox »

The crash reports now supports the following files in it:

client.txt -> The name and version of the lobby client (i.e. SpringLobby 0.77 msw)
information.txt -> Input from the user when he submitted the report, if any...
infolog.txt -> From the Spring dir
script.txt -> Spring start script
ext.txt -> From the Spring dir
unitsync.log -> From the Spring dir
settings.txt -> Springs settings (location can be found in the infolog)
demo.sdf -> Springs demo file as long as the file is 5mb or less (location can be found in the infolog)

These are the names which the files need to have inside the zip archive
Satirik
Lobby Developer
Posts: 1688
Joined: 16 Mar 2007, 18:27

Re: Automated Infolog uploading

Post by Satirik »

the list website misses a lot of <br> in settings list etc
Post Reply

Return to “Engine”