Is the wall load-bearing? The first open concept question
In a typical Central Florida single-storey block home, exterior walls are concrete block and carry the roof. Interior partitions are usually frame, and many carry nothing. Many is not all: anything sitting under a truss bearing point is doing work, and it does not look any different from the ones that are not.
This is not something to determine by knocking on it. Where the wall matters, a structural engineer specifies the header and the permit follows the drawing, reviewed against the Florida Building Code. That adds time at the front of a project and removes the possibility of finding out the expensive way.
What is inside the wall
Even a non-load-bearing wall usually has something in it: circuits, switches, sometimes a vent or a drain line. Those have to go somewhere, and where they go is part of the scope rather than a surprise. A wall with a plumbing stack in it is a much larger job than the same wall without one.
What it does to the room
Worth saying plainly: opening a kitchen also removes the thing that contained cooking noise, cooking smell and mess. Most people are glad they did it. A few miss the wall. A good extractor, vented properly to the outside, does more for the result than anything else in the budget.