Spring RTS Engine

May as well announce rapid: A set of two small tools (commandline and gui) to operate on your local rapid repository.

The commandline tool is mostly meant for power users as simply installing a package can also be done the GUI way. The GUI currently only allows installing single packages.

Anyway, the rapid commandline tool allows you to pin/unpin tags, install/uninstall packages, collect garbage, and rapidly create a .sdd from a .sdp package with a single command. (the latter is useful for engine development )

It can be installed using: Then view the possible commands by running: Or, for the GUI: Thanks go to koshi for figuring how to package python stuff and for creating rapid-gui.

If you have any suggestions, find any bugs, have some patches (code is on github), etc., just post here or speak to me in Lobby.

Nice tool.

Edit: this is solved (setup problem).
There is a bug in install/uninstall:
It only matches against the part until first space? And only full names?

Pinning a specific version works, e.g. Using latest from git, atm 8d7b06e3703f075c83610137945f26d12a67ee53

Other problem: I used SD before and had over time more than 1000 packages installed. I ran "rapid collect-pool". It ran for 10-15 minutes (runtime is lesser issue) and used up to 1.3GB ram.

okay, it appears to be writing pool to files... so what's the memory hog?

Thanks for the feedback.

SirMavericks install/uninstall issue has been narrowed down to his own wrapper shell script ($@ instead of "$@").

The memory hog when using collect-pool when lots of packages are installed may be because it loads for each package the list of files in memory and keeps this list cached in memory. If each such list is 300kb (rough estimate based on 50-200kb gzipped raw data) then 1000 packages would be 300M already. Apparently the python representation is quite somewhat less compact

EDIT: memory issue should be resolved (reduced usage by 95%)
(yay Flyweight pattern)

When trying to use rapid I get the following error on Gentoo Linux with rapid-spring installed from easy_install

admorgan@alexandria ~ $ rapid-gui
Traceback (most recent call last):
File "/usr/bin/rapid-gui", line 5, in <module>
pkg_resources.run_script('rapid-spring==0.3.0', 'rapid-gui')
File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 468, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 1201, in run_script
execfile(script_filename, namespace, namespace)
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/EGG-INFO/scripts/rapid-gui", line 15, in <module>
window = RapidGUI()
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 124, in __init__
self.mainWidget = MainRapidWidget(self)
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 109, in __init__
self.availableWidget = AvailableRapidListWidget(self)
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 95, in __init__
self.sourceModel.reload()
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/models.py", line 29, in reload
self.reloadData( lambda p: not p.installed )
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/models.py", line 18, in reloadData
for p in filter( dataFunction, main.rapid.packages ):
AttributeError: 'module' object has no attribute 'packages'

admorgan wrote:When trying to use rapid I get the following error on Gentoo Linux with rapid-spring installed from easy_install

admorgan@alexandria ~ $ rapid-gui
Traceback (most recent call last):
File "/usr/bin/rapid-gui", line 5, in <module>
pkg_resources.run_script('rapid-spring==0.3.0', 'rapid-gui')
File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 468, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 1201, in run_script
execfile(script_filename, namespace, namespace)
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/EGG-INFO/scripts/rapid-gui", line 15, in <module>
window = RapidGUI()
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 124, in __init__
self.mainWidget = MainRapidWidget(self)
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 109, in __init__
self.availableWidget = AvailableRapidListWidget(self)
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 95, in __init__
self.sourceModel.reload()
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/models.py", line 29, in reload
self.reloadData( lambda p: not p.installed )
File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/models.py", line 18, in reloadData
for p in filter( dataFunction, main.rapid.packages ):
AttributeError: 'module' object has no attribute 'packages'

same error on Debian Squeeze (easy_install and built from source). Filed as http://github.com/tvo/rapid/issues#issue/3

fixed it: http://github.com/tvo/rapid/issues/#iss ... ent/359859

argh why easy_install!?? neds moar pip... easy_install -> deviltool

Shouldn't it install the bitarray dependency by itself?





When it asks me if I meant:
1. ba:latest
2. specialba:latest

Can the correct number to enter to get ba:latest not be 0?

I re-installed with pip instead of easy_install and now it works

Dragon45 wrote:argh why easy_install!?? neds moar pip... easy_install -> deviltool

Is pip some kind of official replacement for easy_install? Any references? I don't seem to find much docs yet that use pip, apart from the pip docs themselves. (which obviously argue pro pip)

lurker wrote:When it asks me if I meant:
1. ba:latest
2. specialba:latest

Can the correct number to enter to get ba:latest not be 0?

Noted.



To all: if there are issues with rapid the preferred form of reporting them is on the issue tracker at github.

According to http://pypi.python.org/pypi/pip and the python irc channel pip is the upcoming replacement to easy_install. The nice thing about pip is that it already works with everything that is easy_install compatible and in this case even made it work (although I can't explain that one).

Tobi wrote:

Dragon45 wrote:argh why easy_install!?? neds moar pip... easy_install -> deviltool

Is pip some kind of official replacement for easy_install? Any references? I don't seem to find much docs yet that use pip, apart from the pip docs themselves. (which obviously argue pro pip)

lurker wrote:When it asks me if I meant:
1. ba:latest
2. specialba:latest

Can the correct number to enter to get ba:latest not be 0?

Noted.



To all: if there are issues with rapid the preferred form of reporting them is on the issue tracker at github.

Ok, thanks. Guess it doesn't hurt to switch the docs to pip anyway.

Instead of doing that I fixed most open bugs / implemented the feature requests and made a new release.

Here's the git shortlog:

hide main function a bit better, and explain it
don't choke on multiple packages with same name, but different hex or dependencies
fix off-by-one error when user was asked to choose from a list
added -y/--yes option to skip confirmations
pin, unpin, install and uninstall now support arbitrary amount of arguments
sort packages and tags in list-[installed-]packages and list-[pinned-]tags
refactor: promote select to TUI
add -r/--regex option to use regex instead of substring matches
sync readme and usage, added options to readme

woo hoo! :D
nice nice!
looks like rapid is the most mature project in the spring community now. leaves little to be desired.

I tried both pip and easy_install and noticed that neither installs dependencies of rapid. The dependency is defined like this in setup.py, in the call to distutils.core.setup: If anyone has any clue what causes this I would appreciate it if you could put it here

EDIT: solved in 0.4.1, programs that read setup.py are pretty inconsistent with each other...

rapid pin ct:test
Traceback (most recent call last):
File "/usr/local/bin/rapid", line 5, in <module>
pkg_resources.run_script('rapid-spring==0.2.0', 'rapid')
File "/usr/lib/python2.6/dist-packages/pkg_resources.py", line 467, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/usr/lib/python2.6/dist-packages/pkg_resources.py", line 1200, in run_script
execfile(script_filename, namespace, namespace)
File "/usr/local/lib/python2.6/dist-packages/rapid_spring-0.2.0-py2.6.egg/EGG-INFO/scripts/rapid", line 6, in <module>
from rapid.main import *
File "/usr/local/lib/python2.6/dist-packages/rapid_spring-0.2.0-py2.6.egg/rapid/main.py", line 41, in <module>
rapid = rapid.Rapid()
File "/usr/local/lib/python2.6/dist-packages/rapid_spring-0.2.0-py2.6.egg/rapid/rapid.py", line 297, in __init__
mkdir(spring_dir)
File "/usr/local/lib/python2.6/dist-packages/rapid_spring-0.2.0-py2.6.egg/rapid/rapid.py", line 42, in mkdir
os.mkdir(path)
OSError: [Errno 17] File exists: '/home/jeykey/.spring'


If Spring directory is a dead link, rapid crashes... I know this is a minor bug, but I wanted to share it anyway

regards, jeykey

Thanks, I'll track it here: http://github.com/tvo/rapid/issues/issue/18

A new Zero-K player has trouble getting rapid to work:

http://pastebin.com/CX84eBn2