Daryl's seen people far less experience than the two of them come and go, so he doesn't share Rick's worry; no matter what this is, it's not Woodbury. Though sometimes he thinks elements of that place wouldn't be so bad-- safe, full of people just living. Just not run by a psychopath. And Deanna's not a nut, he can tell that much. He's uncomfortable with the general tone of the place but not because it might turn bad, just because he's a dirty redneck with no place in anything resembling civilized society. (Sigh.)

Meanwhile:

"With your hands."

Daryl holds out the crossbow to Rick, giving him a flat look.