I didn't notice this the first time I played the game. I'm playing it again as another class and I experienced the same thing as you mentioned. I did go see the Elder but I still have the quest on the list. When I went back and talk to the Elder again, the quest disappeared from the log.
okay i have the solution - after you talk tot he ogre- oyu have to see magggie - she is just past the ogre. Most people talk to her before going to the elder so they never notice that. It is sorta a glitch.