{"id":1024,"date":"2023-03-12T20:18:00","date_gmt":"2023-03-12T14:48:00","guid":{"rendered":"https:\/\/geekpython.in\/?p=1024"},"modified":"2023-08-15T13:52:57","modified_gmt":"2023-08-15T08:22:57","slug":"tempfile-in-python","status":"publish","type":"post","link":"https:\/\/geekpython.in\/tempfile-in-python","title":{"rendered":"How To Use tempfile To Create Temporary Files and Directories in Python"},"content":{"rendered":"\n

Python has a rich collection of standard libraries to carry out various tasks. In Python, there is a module called tempfile<\/strong> that allows us to create and manipulate temporary files and directories.<\/p>\n\n\n\n

We can use tempfile to create temporary files and directories for storing temporary data during the program execution. The module has functions that allow us to create, read, and manipulate temporary files and directories.<\/p>\n\n\n\n

In this article, we’ll go over the fundamentals of the tempfile module, including creating, reading, and manipulating temporary files and directories, as well as cleaning up after we’re done with them.<\/p>\n\n\n\n

<\/a>Creating a temporary file using tempfile<\/h2>\n\n\n\n

The tempfile module includes a function called TemporaryFile()<\/code> that allows us to create a temporary file for use as temporary storage. Simply enter the following code to create a temporary file.<\/p>\n\n\n\n

import tempfile\n\n# Creating a temporary file\ntemp_file = tempfile.TemporaryFile()\n\nprint(f'Tempfile object: {temp_file}')\nprint(f'Tempfile name: {temp_file.name}')\n\n# Closing the file \ntemp_file.close()<\/pre><\/div>\n\n\n\n
First, we imported the module, and because it is part of the standard Python library, we did not need to install it.<\/p>\n\n\n\n
Then we used the TemporaryFile()<\/code> function to create a temporary file, which we saved in the temp_file<\/code> variable. Then we added print statements to display the tempfile object and temporary file name.<\/p>\n\n\n\n
Finally, we used the close()<\/code> function to close the file, just as we would any other file. This will automatically clean up and delete the file.<\/p>\n\n\n\n
Output<\/strong><\/p>\n\n\n\n
Tempfile object: <tempfile._TemporaryFileWrapper object at 0x0000015E54545AE0>\nTempfile name: C:\\Users\\SACHIN\\AppData\\Local\\Temp\\tmp5jyjavv2<\/pre><\/div>\n\n\n\n
We got the location of the object in memory when we printed the object temp_file<\/code>, and we got the random name tmp5jyjavv2<\/code> with the entire path when we printed the name of the temporary file.<\/p>\n\n\n\n
We can specify dir<\/code> parameter to create a temporary file in the specified directory.<\/p>\n\n\n\n
import tempfile\n\n# Creating a temporary file in the cwd\nnamed_file = tempfile.TemporaryFile(\n    dir='.\/'\n)\n\nprint('File created in the cwd')\nprint(named_file.name)\n\n# Closing the file\nnamed_file.close()<\/pre><\/div>\n\n\n\n
The file will be created in the current working directory.<\/p>\n\n\n\n
File created in the cwd\nD:\\SACHIN\\Pycharm\\tempfile_module\\tmptbg9u6wk<\/pre><\/div>\n\n\n\n
<\/a>Writing text and reading it<\/h2>\n\n\n\n
The TemporaryFile()<\/code> function sets the mode parameter 'w+b'<\/code> to the default value to read and write files in a binary mode. We can also use 'w+t'<\/code> mode to write text data into the temporary file.<\/p>\n\n\n\n
import tempfile\n\n# Creating a temporary file\nfile = tempfile.TemporaryFile()\n\ntry:\n    # Writing into the temporary file\n    file.write(b\"Welcome to GeekPython.\")\n    # Position to start reading the file\n    file.seek(0)  # Reading will start from beginning\n    # Reading the file\n    data = file.read()\n    print(data)\nfinally:\n    # Closing the file\n    file.close()\n\n----------\nb'Welcome to GeekPython.'<\/pre><\/div>\n\n\n\n
In the above code, we created a temporary file and then used the write()<\/code> function to write data into it, passing the string in bytes format (as indicated by the prefix 'b'<\/code> before the content).<\/p>\n\n\n\n
Then we used the read()<\/code> function to read the content, but first, we specified the position from which to begin reading the content using the seek(0)<\/code> (start from the beginning) function, and finally, we closed the file.<\/p>\n\n\n\n
<\/a>Using context manager<\/h2>\n\n\n\n
We can also create temporary files using the context managers such as with<\/code> keyword. Also, the following example will show us how to write and read text data into the temporary file.<\/p>\n\n\n\n
import tempfile\n\n# Using with statement creating a temporary file\nwith tempfile.TemporaryFile(mode='w+t') as file:\n    # Writing text data into the file\n    file.write('Hello Geeks!')\n    # Specifying the position to start reading\n    file.seek(0)\n    # Reading the content\n    print(file.read())\n    # Closing the file\n    file.close()<\/pre><\/div>\n\n\n\n
In the above code, we used the with<\/code> statement to create a temporary file and then opened it in text mode('w+t'<\/code>) and did everything the same as we do for handling other files in Python.<\/p>\n\n\n\n
Hello Geeks!<\/pre><\/div>\n\n\n\n
<\/a>Named temporary file<\/h2>\n\n\n\n
To take more control over making the temporary file like naming the temporary file as we want or keeping it or deleting it, then we can use NamedTemporaryFile()<\/code>.<\/p>\n\n\n\n
When creating a temporary file, we can specify a suffix<\/strong> and a prefix<\/strong>, and we can choose whether to delete or keep the temporary file. It has a delete<\/code> parameter that defaults to True<\/code>, which means that the file will be deleted automatically when we close it, but we can change this value to False<\/code> to keep it.<\/p>\n\n\n\n
import tempfile\n\n# Creating a temporary file using NamedTemporaryFile()\nnamed_file = tempfile.NamedTemporaryFile()\n\nprint('Named file:', named_file)\nprint('Named file name:', named_file.name)\n\n# Closing the file\nnamed_file.close()\n\n----------\nNamed file: <tempfile._TemporaryFileWrapper object at 0x000001E70CDEC310>\nNamed file name: C:\\Users\\SACHIN\\AppData\\Local\\Temp\\tmpk6ycz_ek<\/pre><\/div>\n\n\n\n
The output of the above code is the same as when we created the temporary file using the TemporaryFile()<\/code> function, it’s because NamedTemporaryFile()<\/code> operates exactly as TemporaryFile()<\/code> but the temporary file created using the NamedTemporaryFile()<\/code> is guaranteed to have a visible name in the file system.<\/p>\n\n\n\n
How to customize the name of a temporary file?<\/strong><\/p>\n\n\n\n
As you can see, the name of our temporary file is generated at random, but we can change that with the help of the prefix<\/code> and suffix<\/code> parameters.<\/p>\n\n\n\n
import tempfile\n\n# Creating a temporary file using NamedTemporaryFile()\nnamed_file = tempfile.NamedTemporaryFile(\n    prefix='geek-',\n    suffix='-python'\n)\n\nprint('Named file name:', named_file.name)\n\n# Closing the file\nnamed_file.close()<\/pre><\/div>\n\n\n\n
The temporary file will now be created when the code is run, and its name will be prefixed and suffixed with the values we specified in the code above.<\/p>\n\n\n\n
Named file name: C:\\Users\\SACHIN\\AppData\\Local\\Temp\\geek-n6luwuwx-python<\/pre><\/div>\n\n\n\n
<\/a>Creating temporary directory<\/h2>\n\n\n\n
To create a temporary directory, we can use TemporaryDirectory()<\/code> function from the tempfile module.<\/p>\n\n\n\n
import tempfile\n\n# Creating a temporary directory inside the TempDir\ntempdir = tempfile.TemporaryDirectory(\n    dir='TempDir'\n)\n\n# Printing the name of temporary dir\nprint('Temp Directory:', tempdir.name)\n\n# Cleaning up the dir\ntempdir.cleanup()<\/pre><\/div>\n\n\n\n
The above code will create a temporary directory inside the TempDir<\/em><\/strong> directory that we created in the root directory. Then we printed the name of the temporary directory and then called the cleanup()<\/code> method to explicitly clean the temporary directory.<\/p>\n\n\n\n
Temp Directory: TempDir\\tmplfu2ooew<\/pre><\/div>\n\n\n\n
We can use with<\/code> statement to create a temporary directory and we can also specify suffix<\/code> and prefix<\/code> parameters.<\/p>\n\n\n\n
with tempfile.TemporaryDirectory(\n        dir='TempDir',\n        prefix='hey-',\n        suffix='-there'\n) as tempdir:\n    print(\"Temp Dir:\", tempdir)<\/pre><\/div>\n\n\n\n
When we create a temporary directory using the with<\/code> statement the name of the directory will be assigned to the target of the as<\/code> clause. To get the name of the temporary directory, we passed tempdir<\/code> rather than tempdir.name<\/code> in the print statement.<\/p>\n\n\n\n
Temp Dir: TempDir\\hey-q14i1hc4-there<\/pre><\/div>\n\n\n\n
You will notice that this time we didn’t use the cleanup()<\/code> method, that’s because the temporary directory and its content are removed after the completion of the context of the temporary directory object.<\/p>\n\n\n\n
<\/a>SpooledTemporaryFile<\/h2>\n\n\n\n
The SpooledTemporaryFile()<\/code> function is identical to TemporaryFile()<\/code>, with the exception that it stores the data in memory up until the maximum size is reached or fileno()<\/code> method is called.<\/p>\n\n\n\n
import tempfile\n\n# Creating a temporary file to spool data into it\nsp_file = tempfile.SpooledTemporaryFile(max_size=10)\nprint(sp_file)\n\n# Writing into the file\nsp_file.write(b'Hello from GeekPython')\n\n# Printing the size of the file\nprint(sp_file.__sizeof__())\n\n# Printing if data is written to the disk\nprint(sp_file._rolled)\nprint(sp_file._file)<\/pre><\/div>\n\n\n\n
With the max_size<\/code> parameter set to 10<\/strong>, we used the SpooledTemporaryFile()<\/code> function to create a spooled temporary file. It indicates that file size up to 10 can be stored in the memory before it is rolled over to the on-disk file.<\/p>\n\n\n\n
Then we wrote some data into the file and printed the size of the file using the __sizeof__<\/code> attribute.<\/p>\n\n\n\n
There is a rollover()<\/code> method by which we can see whether the data is in the memory or rolled over to the on-disk temporary file. This method returns a boolean value, True<\/strong> means the data is rolled over and False<\/strong> means the data is still in the memory of the spooled temporary file.<\/p>\n\n\n\n
<tempfile.SpooledTemporaryFile object at 0x0000023FFBD0C370>\n32\nTrue\n<tempfile._TemporaryFileWrapper object at 0x0000023FFBD0D930><\/pre><\/div>\n\n\n\n
The temporary file object is SpooledTemporaryFile<\/strong>, as can be seen. Because the amount of data we wrote into the file exceeded the allowed size, the data was rolled over, and we received the boolean value True<\/code>.<\/p>\n\n\n\n
Depending on the mode we specified, this function returns a file-like object whose _file<\/code> attribute is either an io.BytesIO<\/code> or an io.TextIOWrapper<\/code> (binary or text). Up until the data exceeded the max size, this function holds the data in memory using the io.BytesIO<\/code> or io.TextIOWrapper<\/code> buffer.<\/p>\n\n\n\n
import tempfile\n\nwith tempfile.SpooledTemporaryFile(mode=\"w+t\", max_size=50) as sp_file:\n    print(sp_file)\n\n    # Running a while loop until the data gets rolled over\n    while sp_file._rolled == False:\n        sp_file.write(\"Welcome to GeekPython\")\n        print(sp_file._rolled, sp_file._file)<\/pre><\/div>\n\n\n\n
Output<\/strong><\/p>\n\n\n\n
<tempfile.SpooledTemporaryFile object at 0x000001A8901CC370>\nFalse <_io.TextIOWrapper encoding='cp1252'>\nFalse <_io.TextIOWrapper encoding='cp1252'>\nTrue <tempfile._TemporaryFileWrapper object at 0x000001A8906388E0><\/pre><\/div>\n\n\n\n
Until the data is rolled over, we ran a while<\/code> loop and printed the _file<\/code> attribute of the SpooledTemporaryFile<\/code> object. As we can see the data was stored in the memory using the io.TextIOWrapper<\/code> buffer(mode was set to text) and when the data was rolled over, the code returned the temporary file object.<\/p>\n\n\n\n
We can do the same with data in binary format.<\/strong><\/p>\n\n\n\n
import tempfile\n\nwith tempfile.SpooledTemporaryFile(mode=\"w+b\", max_size=50) as sp_file:\n    print(sp_file)\n\n    # Running a while loop until the data gets rolled over\n    while sp_file._rolled == False:\n        sp_file.write(b\"Welcome to GeekPython\")\n        print(sp_file._rolled, sp_file._file)<\/pre><\/div>\n\n\n\n
Output<\/strong><\/p>\n\n\n\n
<tempfile.SpooledTemporaryFile object at 0x00000223C633C370>\nFalse <_io.BytesIO object at 0x00000223C6331580>\nFalse <_io.BytesIO object at 0x00000223C6331580>\nTrue <tempfile._TemporaryFileWrapper object at 0x00000223C67A8850><\/pre><\/div>\n\n\n\n
We can also call fileno()<\/code> to roll over the file content.<\/p>\n\n\n\n
import tempfile\n\nwith tempfile.SpooledTemporaryFile(mode=\"w+b\", max_size=500) as sp_file:\n    print(sp_file)\n\n    for _ in range(3):\n        sp_file.write(b'Hey, there welcome')\n        print(sp_file._rolled, sp_file._file)\n\n    print('Data is written to the disk before reaching the max size.')\n    # Calling the fileno() method\n    sp_file.fileno()\n    print(sp_file._rolled, sp_file._file)<\/pre><\/div>\n\n\n\n
Output<\/strong><\/p>\n\n\n\n
<tempfile.SpooledTemporaryFile object at 0x000001F51D12C370>\nFalse <_io.BytesIO object at 0x000001F51D121580>\nFalse <_io.BytesIO object at 0x000001F51D121580>\nFalse <_io.BytesIO object at 0x000001F51D121580>\nData is written to the disk before reaching the max size.\nTrue <tempfile._TemporaryFileWrapper object at 0x000001F51D5A0970><\/pre><\/div>\n\n\n\n
<\/a>Low-level functions<\/h2>\n\n\n\n
There are some low-level functions included in the tempfile module. We’ll explore them one by one.<\/p>\n\n\n\n
<\/a>mkstemp and mkdtemp<\/h3>\n\n\n\n
mkstemp<\/code> is used for creating a temporary file in the most secure manner possible and mkdtemp<\/code> is used to create a temporary directory in the most secure manner possible.<\/p>\n\n\n\n
They also have parameters like suffix<\/code>, prefix<\/code> and dir<\/code> but mkstemp<\/code> has one additional text<\/code> parameter which defaults to False<\/code>(binary mode), if we make it True<\/code> then the file will be opened in text mode.<\/p>\n\n\n\n
import tempfile\n\n# Using mkstemp\nfile = tempfile.mkstemp(prefix='hello-', suffix='-world')\nprint('Created File:', file)\n\n# Using mkdtemp\ndirectory = tempfile.mkdtemp(dir='TempDir')\nprint('Directory Created:', directory)\n\n----------\nCreated File: (3, 'C:\\\\Users\\\\SACHIN\\\\AppData\\\\Local\\\\Temp\\\\hello-xmtqn88f-world')\nDirectory Created: TempDir\\tmp_6coyqq2<\/pre><\/div>\n\n\n\n
Note<\/strong>: There is a function called mktemp()<\/code> also which is deprecated.<\/p>\n\n\n\n
<\/a>gettempdir<\/strong> and gettempdirb<\/strong><\/h3>\n\n\n\n
gettempdir()<\/code> is used to return the name of the directory used for temporary files and gettempdirb()<\/code> also return the name of the directory but in bytes.<\/p>\n\n\n\n
import tempfile\n\nprint(tempfile.gettempdir())\nprint(tempfile.gettempdirb())\n\n----------\nC:\\Users\\SACHIN\\AppData\\Local\\Temp\nb'C:\\\\Users\\\\SACHIN\\\\AppData\\\\Local\\\\Temp'<\/pre><\/div>\n\n\n\n
<\/a>Conclusion<\/h1>\n\n\n\n
The tempfile<\/strong> module, which offers functions to create temporary files and directories, was covered in this article. We have used various functions from the tempfile module in code examples, which has helped us better understand how these functions operate.<\/p>\n\n\n\n
\n\n\n\n
\ud83c\udfc6Other articles you might be interested in if you liked this one<\/strong><\/p>\n\n\n\n
\u2705Use match case statement for pattern matching in Python<\/a>.<\/p>\n\n\n\n
\u2705Types of class inheritance in Python with examples<\/a>.<\/p>\n\n\n\n
\u2705An improved and modern way of string formatting in Python<\/a>.<\/p>\n\n\n\n
\u2705Integrate PostgreSQL database with Python<\/a>.<\/p>\n\n\n\n
\u2705Argmax function in NumPy and TensorFlow – Are they the same<\/a>?<\/p>\n\n\n\n
\u2705Take multiple inputs from the user in a single line in Python<\/a>.<\/p>\n\n\n\n
\u2705Perform a parallel iteration over multiple iterables using zip() function in Python<\/a>.<\/p>\n\n\n\n
\n\n\n\n
That’s all for now<\/strong><\/p>\n\n\n\n
Keep Coding\u270c\u270c<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"
Python has a rich collection of standard libraries to carry out various tasks. In Python, there is a module called tempfile that allows us to create and manipulate temporary files and directories. We can use tempfile to create temporary files and directories for storing temporary data during the program execution. The module has functions that allow us […]<\/p>\n","protected":false},"author":1,"featured_media":1026,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ocean_post_layout":"","ocean_both_sidebars_style":"","ocean_both_sidebars_content_width":0,"ocean_both_sidebars_sidebars_width":0,"ocean_sidebar":"0","ocean_second_sidebar":"0","ocean_disable_margins":"enable","ocean_add_body_class":"","ocean_shortcode_before_top_bar":"","ocean_shortcode_after_top_bar":"","ocean_shortcode_before_header":"","ocean_shortcode_after_header":"","ocean_has_shortcode":"","ocean_shortcode_after_title":"","ocean_shortcode_before_footer_widgets":"","ocean_shortcode_after_footer_widgets":"","ocean_shortcode_before_footer_bottom":"","ocean_shortcode_after_footer_bottom":"","ocean_display_top_bar":"default","ocean_display_header":"default","ocean_header_style":"","ocean_center_header_left_menu":"0","ocean_custom_header_template":"0","ocean_custom_logo":0,"ocean_custom_retina_logo":0,"ocean_custom_logo_max_width":0,"ocean_custom_logo_tablet_max_width":0,"ocean_custom_logo_mobile_max_width":0,"ocean_custom_logo_max_height":0,"ocean_custom_logo_tablet_max_height":0,"ocean_custom_logo_mobile_max_height":0,"ocean_header_custom_menu":"0","ocean_menu_typo_font_family":"0","ocean_menu_typo_font_subset":"","ocean_menu_typo_font_size":0,"ocean_menu_typo_font_size_tablet":0,"ocean_menu_typo_font_size_mobile":0,"ocean_menu_typo_font_size_unit":"px","ocean_menu_typo_font_weight":"","ocean_menu_typo_font_weight_tablet":"","ocean_menu_typo_font_weight_mobile":"","ocean_menu_typo_transform":"","ocean_menu_typo_transform_tablet":"","ocean_menu_typo_transform_mobile":"","ocean_menu_typo_line_height":0,"ocean_menu_typo_line_height_tablet":0,"ocean_menu_typo_line_height_mobile":0,"ocean_menu_typo_line_height_unit":"","ocean_menu_typo_spacing":0,"ocean_menu_typo_spacing_tablet":0,"ocean_menu_typo_spacing_mobile":0,"ocean_menu_typo_spacing_unit":"","ocean_menu_link_color":"","ocean_menu_link_color_hover":"","ocean_menu_link_color_active":"","ocean_menu_link_background":"","ocean_menu_link_hover_background":"","ocean_menu_link_active_background":"","ocean_menu_social_links_bg":"","ocean_menu_social_hover_links_bg":"","ocean_menu_social_links_color":"","ocean_menu_social_hover_links_color":"","ocean_disable_title":"default","ocean_disable_heading":"default","ocean_post_title":"","ocean_post_subheading":"","ocean_post_title_style":"","ocean_post_title_background_color":"","ocean_post_title_background":0,"ocean_post_title_bg_image_position":"","ocean_post_title_bg_image_attachment":"","ocean_post_title_bg_image_repeat":"","ocean_post_title_bg_image_size":"","ocean_post_title_height":0,"ocean_post_title_bg_overlay":0.5,"ocean_post_title_bg_overlay_color":"","ocean_disable_breadcrumbs":"default","ocean_breadcrumbs_color":"","ocean_breadcrumbs_separator_color":"","ocean_breadcrumbs_links_color":"","ocean_breadcrumbs_links_hover_color":"","ocean_display_footer_widgets":"default","ocean_display_footer_bottom":"default","ocean_custom_footer_template":"0","ocean_post_oembed":"","ocean_post_self_hosted_media":"","ocean_post_video_embed":"","ocean_link_format":"","ocean_link_format_target":"self","ocean_quote_format":"","ocean_quote_format_link":"post","ocean_gallery_link_images":"off","ocean_gallery_id":[],"footnotes":""},"categories":[2,42],"tags":[43,12,31],"class_list":["post-1024","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-python","category-modules","tag-modules","tag-python","tag-python3","entry","has-media"],"_links":{"self":[{"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/posts\/1024","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/comments?post=1024"}],"version-history":[{"count":5,"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/posts\/1024\/revisions"}],"predecessor-version":[{"id":1310,"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/posts\/1024\/revisions\/1310"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/media\/1026"}],"wp:attachment":[{"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/media?parent=1024"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/categories?post=1024"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/geekpython.in\/wp-json\/wp\/v2\/tags?post=1024"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}