They're made of starch. It's like people eating those corn starch packing peanuts over here. The toothpicks are edible, though probably not made in a facility with food grade standards.
Most toothpicks in South Korea are made of sweet potato or corn starch instead of wood. Their green color comes from the food coloring that is applied in the manufacturing process.