The opposition leader also wants to see a referendum on constitutional recognition for Indigenous people in the first term of government, should he win the May 21 election.
Mr Albanese said while his first job as prime minister would be to attend the Quad leaders summit on May 24, he would then set his sights closer to home.
"We will then put in place the structures that you need to drive through that change," he told ABC Radio on Tuesday.
"Structures like our measures to deal with reducing emissions, our national reconstruction fund, our anti-corruption commission ... I want to really raise the issues of greater gender equality in this country, I see that as a major priority for us."
On the first day of pre-polling on Monday, more than 300,000 people cast their ballot ahead of the election.
However, Mr Albanese said he was not surprised Clive Palmer's United Australia Party had preference flows against Labor in several key sears.
"Overwhelmingly, Clive Palmer's preferences seem to be going straight to the Liberal Party in some of those key seats," he said.
"It wasn't a great shock ... in spite of the declarations that have been made that no preference deals were being done."
Election officials have predicted this year's election will have the highest pre-poll voting, eclipsing the more than 30 per cent of voters who did so in 2019.
Australian Electoral Commissioner Tom Rogers said he was not shocked by the large turnout on day one.
"We were expecting an increase in pre-poll and that's exactly what we're seeing at the moment," he told the Nine Network on Tuesday.
"But the more in envelopes through pre-poll and postal, the harder it will be to determine a result on the night."
There were long lines at a number of pre-polling locations across the country on Monday.
As cost of living issues continue to dominate the election, Mr Albanese did not say whether he backed the ACTU's submission to the Fair Work Commission calling for a 5.5 per cent rise to the minimum wage.
While he said workers could not afford to go backwards, the decision should be left to the commission.
"The Fair Work Commission should bear in mind how tough people are doing it, and those people who are on a minimum rate of pay can't afford go backwards," he said.
"People are really struggling out there."
The opposition leader will begin the day in Melbourne, where Labor will announce support for the Suburban Rail Loop project in Victoria.
Labor has committed to spending $2.2 billion on a section of the rail loop to build 26 kilometres of twin tunnels and six underground stations.
Mr Albanese said federal Labor would partner with the Victorian state government on the project.
Meanwhile, the coalition is pitching $5 million in spending on technology to create a "skills passport" to help employees get jobs.
The tool would store information about a worker's experience and education that can be presented to employers.
Employment Minister Stuart Robert said the coalition would partner with the Australian Technology Network of Universities to fast-track the technology's rollout.
"Where there are skills gaps to fill, we want Australians to have the first crack at getting that opportunity and our skills passport approach will enable rapid upskilling and reskilling," he said.
Prime Minister Scott Morrison will start the day in Sydney, spending time in the marginal seat of Bennelong.