Will's blog

purpose: Will Kahn-Greene's blog of Miro, PyBlosxom, Python, GNU/Linux, random content, PyBlosxom, Miro, and other projects mixed in there ad hoc, half-baked, and with a twist of lemon

[ home | blog home | recent activity ]

Page 1 of 27  >> (less recent)

Mon, 30 Jan 2012

Migration to Trac: How some small projects balloon into massive projects when you have good intentions and you're not paying attention

Since around July, I've been working on migrating MediaGoblin from Redmine hosted on the Foocorp servers to Trac hosted on our server. The project looked small enough initially, but then suffered from a series of complications that turned the small project into a big project that took about 6 months and involved writing about 5000 lines of code. Pretty crazy. I don't even want to estimate how many hours I spent on it. Oy.

It wasn't a terrible project, though. Parts of it were educational. I'd written scrapers in Java and Perl a long time ago, but hadn't written anything with Python, lxml, and cssselect [1]. I read through parts of Trac and Trac's db schema. I also read through Trac plugin code.

The best part about it is that it's done now. This gives the GNU MediaGoblin project more autonomy and also more flexibility for adjusting the project to meet their specific needs. That's good stuff---time for cake!

[1]cssselect is amazing. Many thanks to Asheesh for telling me what I was doing was silly and to use cssselect since it's way easier to use. As a side note, Asheesh is teaching Web scraping: Reliably and efficiently pull data from pages that don't expect it at PyCon 2012. If you get the advice I got, it'll be awesome.

Python Miro Community status: January 30th, 2012

What is Python Miro Community

Python Miro Community is an index of Python-related videos on the Internet. For the most part, it's a collection of videos from Python-related conferences. Saw a session you liked and want to share it? It's likely you can find it and share it with Python Miro Community.

Status

Kuma sent me an email pointing out that the download url for one of the PyOhio 2010 videos was kicking up an HTTP 404. We have this problem semi-regularly with the blip.tv urls. A while back I wrote a script to go through a category of videos on Python Miro Community and verify that the urls were good.

I ran the script on the PyOhio 2010 videos and 16 of 20 of them had bad download urls. That sucks.

Between moving things around and changing their interface in a way that makes our uses for blip.tv painful, I'd like conferences to stop using blip.tv. Maybe YouTube is a better venue.

Amongst other things, Universal Subtitles works better with videos posted on YouTube than blip.tv. In fact, if we switched to YouTube, it'd make it _so_ much easier to add Universal Subtitles support and I wouldn't have to use Ogg Vorbis which doesn't work in Safari or on Apple devices.

That's all I have to say about that.

I haven't worked through my queue of conferences, yet. The queue of oustanding tasks is maintained in the PMC GitHub issue tracker. I'm pushing to catch up with things so that it's in a better state for Pycon 2012.

I'm going to PyCon 2012, though this time as a Mozillian. Looking forward to Erik's talks on Parsing horrible things with Python and Speedily practical large-scale tests, Asheesh and Jessica's talk on Diversity in practice: How the Boston Python Meetup grew to 1000 people and over 15% women, Karen's talk on Improving Documentation with "Beginner's Mind" (or: Fixing the Django Tutorial), and others, too.

Wed, 25 Jan 2012

my standing desk

Back in October of 2010, I created a standing desk. A friend of mine bought a Sears workbench and was using that and while it was pretty cool looking, I wanted something I could more easily nail things into. I've been meaning to write about this for a while.

I bought some two-by-fours and plywood and built most of it with that and some scraps of wood I had lying around.

Since then, I built a stool to go with it and bought a shelf thing from Ikea that goes to the right of it.

I think it took a day to build the standing desk, though I've tweaked it a bit since I originally built it. It took a day to build my stool. Total cost in parts for both pieces was definitely under $100.

Result is this:

Standing desk (portrait) Standing desk (landscape)

This set up has lots of horizontal space, is set at the right height for me, lets me sit when I'm weary and stand when I'm not, and has some storage capacity so I'm not surrounded by stuff.

"Wait! What's up with all those computers?", you might ask. Well, the computer breakdown is like this:

Then I have:

The dead computers should go away. The PCF build boxes will eventually be re-homed, too.

And that's the state of my desk!

Wed, 11 Jan 2012

Fix for vagrant keys permission issue

Tim threw together a vagrant setup for Kitsune based on what Alex did in November. I went to give it a try but I'm using vagrant 0.8.10 and it died.

Important part of the error message was:

/var/lib/gems/1.8/gems/net-ssh-2.1.4/lib/net/ssh/key_factory.rb:38:in
`read': Permission denied - /var/lib/gems/1.8/gems/vagrant-0.8.10/keys/vagrant
(Errno::EACCES)

Issue is documented at https://github.com/mitchellh/vagrant/issues/235.

My fix was to do this:

saturn /var/lib/gems/1.8/gems/vagrant-0.8.10/keys> ls -al
total 24
drwxr-xr-x  2 root root 4096 Jan 11 20:00 .
drwxr-xr-x 10 root root 4096 Jan 11 20:00 ..
-rw-r--r--  1 root root  821 Jan 11 20:00 README.md
-rw-------  1 root root 1675 Jan 11 20:00 vagrant
-rw-r--r--  1 root root 1464 Jan 11 20:00 vagrant.ppk
-rw-r--r--  1 root root  409 Jan 11 20:00 vagrant.pub
saturn /var/lib/gems/1.8/gems/vagrant-0.8.10/keys> sudo chmod 644 vagrant
saturn /var/lib/gems/1.8/gems/vagrant-0.8.10/keys>

That fixed it for me. Figured I'd document it so that I could find it again when I bumped into it again.

Wed, 28 Dec 2011

Pyblosxom 1.5 released!

While I was writing up the release blog post, I figured out that I've probably been working on Pyblosxom 1.5 on and off for the last three years or so. That's pretty intense---I knew I'd been working on it for a while, but I didn't realize how long it actually was.

The last year or so of development has been fun. There's a pretty consistent contingent of friendly folks who hang out on #pyblosxom. I really appreciate their humoring me with my period, "Pyblosxom 1.5 is almost done! I just have to ..." announcements.

Details of the release are in the release blog post. If you've been waiting to upgrade, this is a good version to upgrade to.

Going forward, I'm going to take a hiatus from Pyblosxom development. I've got a bunch of other projects that I've been ignoring for a while that really need some attention. I'll continue to review patches, help out on #pyblosxom and the mailing lists, and I'll push out future releases, but I won't be doing any major development for a while.

Sat, 03 Dec 2011

phil 1.0 released!

Mediagoblin has monthly project meetings. One of the things I wanted to automate was meeting reminders that gets sent x days in advance, contain the link to the Meetings page in the wiki, and specify the date and time of the next meeting. I figure if we automate it, it's one less thing we have to think about---it just happens.

To do this, I decided to write phil. For the most part, it's sort of a throw-away project, but it was so small that I decided to go through a complete project development cycle with it and make sure it had all the bits a mature Python project should have: proper packaging, license, configuration, tests, project infrastructure, ...

I think it took about 10 hours over the course of 2 weeks. I was learning the icalendar library and python-dateutil and also figuring out exactly what I wanted it to do as I went along. For a small project like this, that's fine. For a larger project, I'd prefer to spend more time researching and designing ahead of time.

It was nice to "take a vacation" and put all the other projects I normally work on on hold to throw something together from scratch.

Thu, 20 Oct 2011

Python Miro Community status: October 20th, 2011

What is Python Miro Community

Python Miro Community is an index of Python-related videos on the Internet. For the most part, it's a collection of videos from Python-related conferences. Saw a session you liked and want to share it? It's likely you can find it and share it with Python Miro Community.

Status

I've finished posting DjangoCon 2011 videos.

They're all set up to be transcribed and translated. If you have spare time, please think about taking the time to transcribe your favorite presentation. If it's transcribed already and you can translate it, please translate it.

I'm keeping track of transcription/translation status now.

I fixed the RSS links for categories so that if you subscribe to that RSS feed, it has the complete category in it--not just the most recent 30 videos. If you're using a podcast client and are subscribed to one of the category feeds, please fix the feed url in your podcast client.

I've got PyCon AU 2011 in the queue. In fact, I have an actual queue now maintained in the PMC GitHub issue tracker. That includes other things that need to be fixed in the site or in my scripts that help me maintain the site.

Fri, 23 Sep 2011

Python Miro Community status: September 23rd, 2011

What is Python Miro Community

Python Miro Community is an index of Python-related videos on the Internet. For the most part, it's a collection of videos from Python-related conferences. Saw a session you liked and want to share it? It's likely you can find it and share it with Python Miro Community.

Status

The last month and a half have been pretty banal. There have been several conferences (DjangoCon 2011, PyConAU 2011, ...), but I haven't had time to pull in video, yet. I started to look at things earlier this week and was met with a bunch of Miro Community problems.

First, looks like either Blip.tv did something weird with their feeds or Miro Community decided to stop filtering duplicates, so there are currently over 500 videos in the review queue many of which are on the site already. I have no good way to figure out which are duplicates, though, so I'm going to write a script to make that possible/easier.

Second, videos from PyCon 2011 and PyOhio 2011 that had been "universal subtitle-ized" were exceeding the width allotted to the video. I've fixed this before, but I didn't remember how I did it and I decided this time around that I'd just change the layout of the page instead. Now the video can take up as much width as it wants (which is good for other reasons, too) and I nixed bits of the page that Python Miro Community doesn't use.

Irksome that things keep breaking, but that's the way it goes. I'm sorry I didn't catch the latter one sooner.

Universal Subtitles status

Carl was curious as to how many videos had been transcribed of the two conferences we've added Universal Subtitles support for. I wrote a script to go through the PyCon 2011 videos and PyOhio 2011 videos and figure out how many of them have been transcribed and translated with Universal Subtitles.

PyCon 2011:3 videos fully transcribed, 1 video partially transcribed, some minor translation work
PyOhio 2011:3 videos partially transcribed

I'm disappointed. It was a lot of work to get those videos working with Universal Subtitles. It sucked that it took me so long to post them and it's probably the case we lost some of the energy because of that. But I was hoping we'd have better results anyways.

Carl wants to try one more time with DjangoCon 2011 and this time be more proactive and email the presenters. If that doesn't work, then I'm not sure what we can do. I can't spend the time to transcribe all the talks. Neither can Carl. We could pay someone to do it, but that costs money and I don't think anyone is interested in paying for that. Thus if we con't share the workload as a community, I'm probably going to ditch the Universal Subtitles support for now because it's a lot of work to put together. Maybe we can try it again some day.

PMC in GitHub

I'm putting scripts, template fixes, and other Python Miro Community related things in Github: http://github.com/willkg/pmc

I'm not sure how interesting it is outside of PMC, but it's there if you're interested.

Wed, 07 Sep 2011

Help fund PyGotham 2011 video!

Carl put up a Pledgie campaign for raising $4,600 to cover the costs for videoing PyGotham 2011.

For $4,600, we're getting a lot of bang for our buck. Amongst other things:

PyGotham 2011 is only a couple of weeks away. They have a pretty great speaker line-up. My manager is going to talk about Moving Fast with Django covering deployment pipelines!

Your help funding video for this conference makes a big difference! Please donate!

Wed, 03 Aug 2011

PyOhio 2011 videos being posted

PyOhio 2011 happened last weekend. I'm currently working with Carl at Next Day Video to get the videos they're posting to the blip.tv feed into Python Miro Community.

I'm using a similar process to what we used with PyCon 2011 videos, but we don't have to figure it out on the fly this time around, so things are going much smoother.

As of now, there are three videos posted with more coming as they're uploaded and work their way through the workflow.

If you have some spare time, please consider helping out with subtitling the videos. Whenever a video is subtitled, it becomes accessible to a much wider audience. If you help out with subtitling, please let me know so that I can thank you.

Page 1 of 27  >> (less recent)


pyblosxom::1.5-dev git-master

Copyright 1996 to 2012, Will Guaraldi Kahn-Greene, under the Creative Commons BY-SA 3.0 license

Creative Commons License
Will's Blog by William Kahn-Greene is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.