There is a nice little blog entry which explains how to convince iTunes to take other media into your media library. The command is:
SetFile -t “MooV” -c “TVOD” some-movie.avi
When you’ve installed Perian, iTunes should then accept almost any movie, be it avi, mkv or xvid.