I just recently downloaded and installed writer2xhtml (http://extensions.services.openoffice.org/project/writer2xhtml) for my OpenOffice Writer. This extension installs in the same manner as a Firefox or Chrome extension for your browser (and there’s no need to restart OpenOffice after the install). I was converting Word document files into html and I was looking for a cleaner way to save HTML (from both OpenOffice and Word). This extension leaves minor HTML cleanup for the user (which you can use Dreamweaver or Kompozer). You can also customize the extension (like CSS behavior- you can find how to customize in the manual posted here: http://writer2latex.sourceforge.net/index15.html )
To find the extension, go to File–> Export–> you will now see XHTML 1.0 Strict, XHML 1.1 + MathML 2.0 (.xhtml), and XHTML 1.1 + MathML 2.0 (xsl, xml) as exporting options. Choose the appropriate setting for the file you want to save (first two work if you just want html).
I hope this helps!