So it seems that the quest item will not drop once you dont need it anymore. Havnt seen any piece of cloth since I reached the evil lab.