Joined: 01 Jun 2005, 10:36 Location: The Netherlands
May as well announce rapid: A set of two small tools (commandline and gui) to operate on your local rapid repository.
The commandline tool is mostly meant for power users as simply installing a package can also be done the GUI way. The GUI currently only allows installing single packages.
Anyway, the rapid commandline tool allows you to pin/unpin tags, install/uninstall packages, collect garbage, and rapidly create a .sdd from a .sdp package with a single command. (the latter is useful for engine development )
It can be installed using:
Code:
easy_install rapid-spring
Then view the possible commands by running:
Code:
rapid
Or, for the GUI:
Code:
rapid-gui
Thanks go to koshi for figuring how to package python stuff and for creating rapid-gui.
If you have any suggestions, find any bugs, have some patches (code is on github), etc., just post here or speak to me in Lobby.
Other problem: I used SD before and had over time more than 1000 packages installed. I ran "rapid collect-pool". It ran for 10-15 minutes (runtime is lesser issue) and used up to 1.3GB ram.
Joined: 01 Jun 2005, 10:36 Location: The Netherlands
Thanks for the feedback.
SirMavericks install/uninstall issue has been narrowed down to his own wrapper shell script ($@ instead of "$@").
The memory hog when using collect-pool when lots of packages are installed may be because it loads for each package the list of files in memory and keeps this list cached in memory. If each such list is 300kb (rough estimate based on 50-200kb gzipped raw data) then 1000 packages would be 300M already. Apparently the python representation is quite somewhat less compact
EDIT: memory issue should be resolved (reduced usage by 95%) (yay Flyweight pattern)
When trying to use rapid I get the following error on Gentoo Linux with rapid-spring installed from easy_install
admorgan@alexandria ~ $ rapid-gui Traceback (most recent call last): File "/usr/bin/rapid-gui", line 5, in <module> pkg_resources.run_script('rapid-spring==0.3.0', 'rapid-gui') File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 468, in run_script self.require(requires)[0].run_script(script_name, ns) File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 1201, in run_script execfile(script_filename, namespace, namespace) File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/EGG-INFO/scripts/rapid-gui", line 15, in <module> window = RapidGUI() File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 124, in __init__ self.mainWidget = MainRapidWidget(self) File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 109, in __init__ self.availableWidget = AvailableRapidListWidget(self) File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 95, in __init__ self.sourceModel.reload() File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/models.py", line 29, in reload self.reloadData( lambda p: not p.installed ) File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/models.py", line 18, in reloadData for p in filter( dataFunction, main.rapid.packages ): AttributeError: 'module' object has no attribute 'packages'
Joined: 05 Jan 2010, 13:30 Location: Dresden, Germany
admorgan wrote:
When trying to use rapid I get the following error on Gentoo Linux with rapid-spring installed from easy_install
admorgan@alexandria ~ $ rapid-gui Traceback (most recent call last): File "/usr/bin/rapid-gui", line 5, in <module> pkg_resources.run_script('rapid-spring==0.3.0', 'rapid-gui') File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 468, in run_script self.require(requires)[0].run_script(script_name, ns) File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 1201, in run_script execfile(script_filename, namespace, namespace) File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/EGG-INFO/scripts/rapid-gui", line 15, in <module> window = RapidGUI() File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 124, in __init__ self.mainWidget = MainRapidWidget(self) File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 109, in __init__ self.availableWidget = AvailableRapidListWidget(self) File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/gui.py", line 95, in __init__ self.sourceModel.reload() File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/models.py", line 29, in reload self.reloadData( lambda p: not p.installed ) File "/usr/lib64/python2.6/site-packages/rapid_spring-0.3.0-py2.6.egg/rapid/models.py", line 18, in reloadData for p in filter( dataFunction, main.rapid.packages ): AttributeError: 'module' object has no attribute 'packages'
Is pip some kind of official replacement for easy_install? Any references? I don't seem to find much docs yet that use pip, apart from the pip docs themselves. (which obviously argue pro pip)
lurker wrote:
When it asks me if I meant: 1. ba:latest 2. specialba:latest
Can the correct number to enter to get ba:latest not be 0?
According to http://pypi.python.org/pypi/pip and the python irc channel pip is the upcoming replacement to easy_install. The nice thing about pip is that it already works with everything that is easy_install compatible and in this case even made it work (although I can't explain that one).
Is pip some kind of official replacement for easy_install? Any references? I don't seem to find much docs yet that use pip, apart from the pip docs themselves. (which obviously argue pro pip)
lurker wrote:
When it asks me if I meant: 1. ba:latest 2. specialba:latest
Can the correct number to enter to get ba:latest not be 0?
Joined: 01 Jun 2005, 10:36 Location: The Netherlands
Instead of doing that I fixed most open bugs / implemented the feature requests and made a new release.
Here's the git shortlog:
Quote:
hide main function a bit better, and explain it don't choke on multiple packages with same name, but different hex or dependencies fix off-by-one error when user was asked to choose from a list added -y/--yes option to skip confirmations pin, unpin, install and uninstall now support arbitrary amount of arguments sort packages and tags in list-[installed-]packages and list-[pinned-]tags refactor: promote select to TUI add -r/--regex option to use regex instead of substring matches sync readme and usage, added options to readme
Joined: 01 Jun 2005, 10:36 Location: The Netherlands
I tried both pip and easy_install and noticed that neither installs dependencies of rapid. The dependency is defined like this in setup.py, in the call to distutils.core.setup:
Code:
requires=['bitarray'],
If anyone has any clue what causes this I would appreciate it if you could put it here
EDIT: solved in 0.4.1, programs that read setup.py are pretty inconsistent with each other...
rapid pin ct:test Traceback (most recent call last): File "/usr/local/bin/rapid", line 5, in <module> pkg_resources.run_script('rapid-spring==0.2.0', 'rapid') File "/usr/lib/python2.6/dist-packages/pkg_resources.py", line 467, in run_script self.require(requires)[0].run_script(script_name, ns) File "/usr/lib/python2.6/dist-packages/pkg_resources.py", line 1200, in run_script execfile(script_filename, namespace, namespace) File "/usr/local/lib/python2.6/dist-packages/rapid_spring-0.2.0-py2.6.egg/EGG-INFO/scripts/rapid", line 6, in <module> from rapid.main import * File "/usr/local/lib/python2.6/dist-packages/rapid_spring-0.2.0-py2.6.egg/rapid/main.py", line 41, in <module> rapid = rapid.Rapid() File "/usr/local/lib/python2.6/dist-packages/rapid_spring-0.2.0-py2.6.egg/rapid/rapid.py", line 297, in __init__ mkdir(spring_dir) File "/usr/local/lib/python2.6/dist-packages/rapid_spring-0.2.0-py2.6.egg/rapid/rapid.py", line 42, in mkdir os.mkdir(path) OSError: [Errno 17] File exists: '/home/jeykey/.spring'
If Spring directory is a dead link, rapid crashes... I know this is a minor bug, but I wanted to share it anyway
Users browsing this forum: No registered users and 0 guests
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot post attachments in this forum