There is a new Rob Pattinson (Cedric Diggory) article online and it mentions his feelings about Harry Potter.

Rob’s first big role was playing Cedric Diggory in Harry Potter and the Goblet of Fire. Rob was a bit jealous of the other Harry Potter actors because he knew they had another three films guaranteed, whereas his character died so he wouldn’t be in any more Harry Potter movies.