Sri Lanka told promise to free displaced must be followed by action