What did Crusoe mean when he said in the chapter that The expectation of evil is more bitter than the suffering?

This quote
occurs in chapter 13. In this chapter,is horrified to spot men he calls "savages" on
his side of the island, on the beach only about two miles from where he lives. He tries to
disguise the evidence that he lives on the island, fearing they will hunt him down if they
realize a human occupies the place. After they leave, he examines the beach where they were
feasting and dancing and finds the remains of...