One note on the AWS zenpack that was driving me nuts during development. My development box was running in a vm on my local box. I hadn't setup my ntp service so my time was off due to putting my MAC in sleep mode each day. When the secure key is created to connect to AWS it is time sensitive and will cause errors like you saw earlier. If you start to have collection problem with AWS after it has been working I would do a quick time check.
-Rob