Iranian forward Mehdi Taremi found the back of the net from the penalty spot in the 13th minute and completed his brace five minutes later.
Asteras pulled a goal back in the stoppage time by Dimitrios Emmanouilidis.
Olymoiacos is seventh with three points.
OFI Crete leads the table with six points, thanks to a superior goal difference.