I recognise that they would not see them as such, but are people in areas of Palestine like Gaza and the West Bank still technically Israelis? Are those areas still technically a part of the recognised nation state of Israel?
No, they're not Israelis and they've never been. The Palestinians that live in Gaza and the West Bank (and East Jerusalem) are citizens of the State of Palestine, but that's not a universally recognized state (oh, Israel is neither but has wider recognition).
After the failed UN partition plan, in 1948 war broke out between Israel and its neighbours and in 1949 an armistice was signed with the "Green Line" delineating Israel. Pending a final peace resolution, the "Green Line" is the recognized border of Israel. Egypt occupied and militarily administered the Gaza Strip. Jordan annexed the West Bank and East Jerusalem; no other country save the UK recognized this annexation.
In 1967, Israel conquered the Gaza Strip as well as the West Bank and East Jerusalem, as well as the Syrian territory of the Golan Heights.
Within Israel proper, i.e., within the Green Line, approx. 80% of the population are Jewish Israelis and 20% are Arab Israelis, the latter mainly in the Galilee, and some very small groups (Bedouins, Circassians), all Israeli citizens. Until the 1970s, the Arab Israelis lived under military administration. They've gradually gotten nearly the same rights as Jewish Israelis, mainly due to various court cases. Every election cycle, routinely the government outlaws Arab political parties who then have to go to court to get on the ballot.
The Golan Heights have been annexed by Israel somewhere in the 1990s; nobody recognizes this annexation. Its inhabitants are Israeli settlers - only Jewish ones, of course.
The West Bank has been divided into three areas A, B, and C. Area "A" is under Palestinian administration, except for security issues, i.e., the Israeli army can barge in at any moment under any pretext. Area "B" is mixed administration, and area "C" is under Israeli administration, i.e., it consists of Israeli settlements for Jewish Israeli settlers. Of course, area "A" is not one contiguous area but consists of four or five disjoint areas that are separated by road blocks and checks and walls.
East Jerusalem is separate from the West Bank and has been annexed by Israel right away in 1967. This annexation is recognized by no country, except now apparently by the USA as it recognizes "Jerusalem" as the Israeli capital, not "West Jerusalem". Its borders have been widely expanded from the British/Jordanian borders and Israel builds large Jewish settlements on its eastern borders. The Palestinian inhabitants of East Jerusalem have "permanent resident" status but Israel pulls all kind of tricks to make their life difficult. For instance, if you're born and raised there, and then decide to go a year abroad to study, you'll find that you won't get back your resident status.
The Gaza Strip only had six small Jewish settlements when Sharon evacuated it in 2002. Gaza is now administered by Hamas, but Israel still controls its airspace, its sea shore and all of its land borders except for the Rafa border crossing with Egypt.