Poor experience after enabling agent memory

When the agent opens the memory and adds memory nodes, it always uses memory answers in multiple rounds of conversations, which is very uncomfortable to use; I don’t know why the same system prompt words and model configurations are used normally on dify; And the memory table structure does not have message time, would it cause any problems if I modify the table structure by adding fields and default values on my own