Skip navigation

Generating Sitemaps

Posted by JeremyGThomas Apr 10, 2009

active.com is an aggregator of data from disparate sites within the Active Network.  Because the source of content is distributed and because we have so much of it, creating a sitemap.xml file for SEO purposes has become challenging.  We're working on a new search solution (which you can access in Beta at http://labs.active.com/search) , and the engine behind that has a sitemap.xml generating capability.

 

But there's only one problem: the file it generates is huge.

 

According to https://www.google.com/webmasters/tools/docs/en/protocol.html, a sitemap file can only be 10MB in size or up to 30,000 URLs (whichever comes first). The sitemap for active.com has over 220,000 URLs and is about 34MB in size.

 

We needed an application that would split the sitemap.xml file, according to the constraints above.  I searched all over the internet for something that would do this, and was found only with commercial applications that wanted to crawl my site before generating/splitting the sitemap.xml files.

 

So, my team developed a simple, .NET-based application that splits a large sitemap.xml file into smaller ones, and also creates the sitemap index file which references them.

 

Because I'm feeling philanthropic, I decided to give you access to this tool, free of charge.  Download it here.

3,238 Views 6 Comments Permalink Tags: active, seo, sitemap

Made Over

Posted by JeremyGThomas Apr 8, 2009

After much anticipation we have finally released our new Event Details page.  Check out the screencast below, browse around active.com and let us know what you think.

 

2,043 Views 2 Comments Permalink Tags: active, product_development, event_details

We've just released our newest project to labs.active.com, Active Classifieds.  Have you ever wanted to assemble a group of people to block wind for you on a weekend ride or sell an old baseball glove

 

Active Classifieds is a simple app designed to make it easy for you to sell your old sports stuff or meetup with like-minded people. 

 

Dive in and let us know what you think.

2,151 Views 2 Comments Permalink Tags: beta, active, classifieds, product_development, labs

Active's Pepsi Challenge

Posted by jspitzberg Feb 26, 2009

In the latest installment of "[No man can...|http://www.imdb.com/title/tt0061512/]" challenges, we bring you the Active.com Product Developer Pepsi Challenge.  Can any of these fine men drink 2-liters of Pepsi in less than 4 minutes?  Let's, as they say, go to the video tape...

 

2,359 Views 0 Comments Permalink Tags: active, competition

Coming Soon.

Posted by JeremyGThomas Feb 20, 2009

Based on what our analytics tools tell us, many of you go straight to what we call our "event details" pages on active.com.  These pages are designed to showcase information about, say, a 10k, to help you decide if you want to register or not (check out the event details page for the Niantic Bay 10K, for example).

 

We think there's a lot that can be improved about this page.  Namely A) it's design, B) the speed at which it loads, and C) its lack of focus on, well, you.  So we're starting into a sequence of updates that will spice things up bit.  Here's a preview of what's coming in the first update.

 

 

It's got a completely re-vamped look and feel.  We've also modified the reviews system, making it so people who review an event also rate it on a scale of 1 - 5 (using our fancy stars). 

 

Future releases will include Youtube and Flickr integration as well as a host of other goodies.  But look for this update in the next month or so!

1,782 Views 0 Comments Permalink Tags: active, product_development, event_details

We recently rolled out a private Beta for our new Search solution.  Not only is it a good functional test for us, we're also experimenting with Amazon EC2 and S3 for hosting and data storage.  And from what I've seen so far I'm impressed with Amazon and the approach they've taken to cloud computing. 

 

Amazon has made it dead easy to provision new servers.  They've created a collection of webservices to integrate to for starting and stopping instances.  It seemed odd to me, at first, that I'd have to manage my infrastructure through SOAP calls.  But client-side tools like Elasticfox and now Amazon's own AWS Console make it easy to manage.  There's also a good selection of Windows and various Linux flavors to choose from when setting up servers (we're running mostly Ubuntu 8.1.0 in Labs).

 

We wanted to make our Labs infrastructure extensible so we can new pilot applications quickly, regardless of platform.  To do this we're setting an Apache server on an EC2 Ubuntu host that routes http://labs.active.com to the appropriate app.  Requests to the base URL will be sent to a CMS/wiki that describes the various things we're working on.  Search, which currently resides in the root, will soon be available at http://labs.active.com/search.  Any future pilot we rollout will be available, then, at http://labs.active.com/{pilot-name}.

 

We're also setting up "global" memcached and MySQL servers, so that any application deployed to labs might benefit from these services (we love memcached by the way). 

 

Each pilot application will be responsible for load balancing its requests.  The Search application uses HA proxy running on a dedicated Ubuntu server to route requests to a collection of Apache instances running mod_rails distributed across Ubuntu "workers" (we can scale horizontally here, pending load, by adding more workers).

 

So far (and it's been about 1.5 months) we haven't had any Amazon-caused downtime.  Personally, I think this is a game changer.

2,450 Views 2 Comments Permalink Tags: cloud_computing, amazon, ec2, infrastructure, labs

We now have over 100 users in our Search Beta, and the feedback we've received so far has been positive. One user has asked:

 

"I would love to see something interactive where I could quickly access different multimedia from past events. It wouldn't necessarily be official race photos (I'd actually prefer that they weren't) but even links to a search results page for the event's name in Flickr or YouTube would be great. Even a search OUTSIDE the active network, bringing me to different bloggers who have posted about the events or written race reports from past events would be great to see."

 

I couldn't agree more.  There's a ton of interesting, relevant content out there in the cloud that would add value to search.  We're working now to implement this feature, pulling in photos from flickr, videos from youtube, tweets from twitter and blog posts from technorati (a blog search engine).

 

Sign up for access to our Search Beta at http://labs.active.com/users/new using the invite code "blogsearchinvite".

 

update: we've just rolled out integration to Twitter, Flickr and Youtube!

1,668 Views 0 Comments Permalink Tags: beta, active, search, product_development

We've been listening to our users, like bikehugger, who asks "Possibly not enough coffee, but has anyone else just stared at Active.com wondering how to register for an event?" (http://twitter.com/bikehugger/statuses/998940596).  Our users want to a) find the events to register for and b) run through a no-hassle registration process.

 

Here we're addressing "a" - making it easier to find stuff to do.

 

So we've been working to make search a bit easier and a bit more relevant.  I'm happy to invite you to our highly experimental, closed search beta.  The first 100 users can sign-up at http://labs.active.com/users/new, using the invite code "blogsearchinvite".  

 

Watch this screencast to get a better idea of where we're headed.

2,541 Views 1 Comments Permalink Tags: video, beta, search, product_development, invite

Active Video

Posted by ActiveFergy Dec 18, 2008

For some time now, Jumpcut has been Active's video provider.  As some of you may be aware, Yahoo has decided to shelve Jumpcut and they are no longer accepting video uploads.  The decision to halt uploads came as a surprise to us; we were notified only a week prior.  Since our video migration is scheduled in early 2009, this leaves us in the unfortunate position of turning off video uploads on the Active website.  We are trying our best to retrieve the current video content and will restore functionality soon.

1,421 Views 0 Comments Permalink

Dailymile Launches

Posted by JeremyGThomas Dec 18, 2008

Congrats to Ben Weiner and Kelly Korevec for the public launch of dailymile.com.  I admire the way dailymile focuses on building user communities around events.  The UI is easy to use and intuitive, and they've amassed a good userbase while in private beta.  I especially like the feature where users can submit events, and this is something we're contemplating doing here at Active too.

 

You can read about their launch here.

 

update: turns out we have an older feature that allows users to submit events here.

2,336 Views 1 Comments Permalink Tags: endurance, competition, dailymile

Shout out to WePlay

Posted by JeremyGThomas Dec 9, 2008

Our friends over at WePlay posted a great video about Agile standup meetings the other day.

 

 

We're particularly impressed by their guest star!  Check out the blog post here.

1,598 Views 0 Comments Permalink Tags: competition, agile, product_development

The Active Lifestyle

Posted by jspitzberg Dec 4, 2008

I guess this is what passes for fun around here.

 

 

 

The lesson, as always, is don't brag that you can do the same number of sit-ups that you could do when you were 12 unless you can do the same number of sit-ups that you could do when you were 12!

 

This is all the result of a "warped" corporate culture here at Active where we are encourage to... well, BE active.  A great example of this is the Active X program that our Art Director, Arch Fuston has put together.  There's a full and a lite version for those of different fitness levels.  It's great fun and a killer workout, as I'm sure Damon will attest.

1,612 Views 3 Comments Permalink Tags: active, activex, competition

Skin to Win

Posted by jspitzberg Dec 4, 2008

New advertiser, and a "fun" new way to feature them on the site. We built a Gaiam "skin" for our Mind and Body channel.

 

 

I think it's a nice way to strongly brand the page without being obtrusive and getting in the way of the content that the user has come to the site to find. It's also not the most difficult implementation ever - which is nice. The trickiest part was getting the logo on the background image to be clickable. It took an anchor tag being blocked and relatively positioned to make that happen. Of course the hardest part of that was - and isn't everything - dealing with cross-browser DOM/box model inconsistencies.

 

 

1,434 Views 1 Comments Permalink Tags: development

Jumpcut to BrightCove

Posted by ActiveFergy Nov 11, 2008

Active.com currently uses Jumpcut as its video provider.  With support for Jumpcut waning, we have decided to move our content to a new provider – BrightCove.  BrightCove offers a newly updated product and an extensive API.  We have already begun implementing BrightCove’s video player on some of our pages (see our Tour de France page) and we look forward to working with their services.  

 

The difficulty, of course, is always in the details.  You can see from our video edit page that Jumpcut allows videos to be edited within a web browser.  These edits are stored by Jumpcut and when a video is requested, the finalized version is created on the fly and shown in a flash viewer.  The current issue is one of retrieval.  What is an effective method for making these videos downloadable?  Requests to Jumpcut for this information have not been forthcoming. 

 

Interestingly, another website, ClipNabber, allows users to download flash videos from video providers such as YouTube, Yahoo Videos, and Jumpcut.   There are some Jumpcut limitations which prevent us from retrieving all of our content, but we can at least begin the process with some of our videos.

 

Once this issue of retrieval is resolved we can copy the content, titles and descriptions for transfer into BrightCove.  More to come as we dive deeper into the migration process!

1,981 Views 0 Comments Permalink Tags: video, development, product_development

Scaling results.active.com

Posted by JeremyGThomas Nov 10, 2008

results.active.com is our hub for communicating race results to people.  We train event timers on how to use the backend portion of the system, and after a given race is completed the timers upload results, making them available to the world at large. 

 

We typically see a lot of traffic on results.active.com after large events, such as the Marine Corps Marathon or the Chicago Marathon.  And to be fair, results.active.com hasn't had an exemplary performance record when it comes to handling the volume spikes we get on the Monday after major events.

 

We've just released a major update to results.active.com adding 3X the scalability we had before.  We've also made tweaks to the architecture so that we can add additional servers to the load-balancer should we get any unanticipated increases in volume.

 

So if you see any issues with site responsiveness please let me know (here on this blog) and I'll look to it personally and immediately.

1,655 Views 1 Comments Permalink Tags: development, speed, results, scalability
1 ... 3 4 5 6 7 Previous Next