Programming a NOW

INKTOMI
This is the bad part...
  • HotBot has 80-1000 threads per node
  • Communication is harder than shared-memory
  • Difficult to monitor/debug/tune whole cluster
  • Solution: Sequetial Interface
  • Hide nastiness inside simple interface (like HTTP)
  • Example: parallel search is just a library
  • Inktomi strategy:
    • We build the nasty parts
    • Users/partners program as usual