Home | History | Annotate | Download | only in newfs
History log of /src/sbin/newfs/newfs.c
RevisionDateAuthorComments
 1.120  05-Jul-2023  riastradh Revert "newfs(8): Ensure A divides S before aligned_alloc(A, S)."

C17 lifted this restriction.
 1.119  04-Jul-2023  riastradh newfs(8): Ensure A divides S before aligned_alloc(A, S).

Required by C11 Sec. 7.22.3.1 The aligned_alloc function, para. 2,
p. 348:

The value of alignment shall be a valid alignment supported by the
implementation and the value of size shall be an integral multiple
of alignment.

XXX pullup-10
 1.118  17-Nov-2022  chs Restore backward compatibility of UFS2 with previous NetBSD releases by
disabling support in UFS2 for extended attributes (including ACLs).
Add a new variant of UFS2 called "UFS2ea" that does support extended attributes.
Add new fsck_ffs operations "-c ea" and "-c no-ea" to convert file systems
from UFS2 to UFS2ea and vice-versa (both of which delete all existing extended
attributes in the process).
 1.117  16-Apr-2022  andvar fix various typos in comments and log messages.
 1.116  17-Apr-2020  jdolecek align buffers used for I/O to DEV_BSIZE so it's executed more optimally
when run for xbd(4) device
 1.115  08-Feb-2017  rin branches: 1.115.12;
Add smaller versions of fsck_ffs(8) and newfs(8) for install media, where
support for Endian-Independent FFS and Apple UFS is disabled unless FFS_EI=1
and APPLE_UFS=1 are added to CRUNCHENV, respectively.

This reduces the size of ramdisk image for atari by over 15KB.

Thanks tsutsui and christos for their useful comments.
 1.114  01-Apr-2016  ryo branches: 1.114.2; 1.114.4;
no need to escape
 1.113  25-Jul-2015  mlelstv Handle getfsspecname errors.
 1.112  25-Oct-2014  mlelstv Support wedge names.

before:
newfs dk1 - formats /dev/rdk1
newfs rdk1 - cannot open /dev/rrdk1
newfs /dev/dk1 - /dev/dk1 is a block-device, use raw device
newfs /dev/rdk1 - formats /dev/rdk1

now:
newfs dk1 - formats /dev/rdk1
newfs rdk1 - cannot open /dev/rrdk1
newfs /dev/dk1 - formats /dev/rdk1 (*)
newfs /dev/rdk1 - formats /dev/rdk1
newfs NAME=wedge - formats /dev/rdk1

(*) getfsspecname() returns the block device which must be translated.
Passing a block device manually cannot be distinguished from this case.
 1.111  30-Jun-2012  tsutsui branches: 1.111.10;
Use 32KB/4KB for default block/fragment size on >= 128 GB partitions
for modern AFT disks. No particular comments against PR install/46629.
 1.110  13-Feb-2012  wiz branches: 1.110.2;
Remove unused variables.
From cppcheck via Henning Petersen in PR 46004.
 1.109  06-Mar-2011  bouyer branches: 1.109.4;
merge the bouyer-quota2 branch. This adds a new on-disk format
to store disk quota usage and limits, integrated with ffs
metadata. Usage is checked by fsck_ffs (no more quotacheck)
and is covered by the WAPBL journal. Enabled with kernel
option QUOTA2 (added where QUOTA was enabled in kernel config files),
turned on with tunefs(8) on a per-filesystem
basis. mount_mfs(8) can also turn quotas on.

See http://mail-index.netbsd.org/tech-kern/2011/02/19/msg010025.html
for details.
 1.108  09-Aug-2010  pooka branches: 1.108.2;
Add -G to usage, omission pointed out by wiz. Also, make usage format
nicer on a 80col terminal.
 1.107  09-Aug-2010  pooka Add -G, which turns consistency check errors in warnings. The
current testing purpose is to create a file system with
block size > MAXPHYS.

(the check doesn't make that much sense anyway in these days of
mobile file systems, since we're interested in MAXPHYS where we
attempt to mount the file system, not where we happen to create it)
 1.106  20-Dec-2009  dsl Push the mount path for mount_mfs through realpath().
This matches what other fs do.
Fixes PR/20362
 1.105  07-May-2009  lukem Consistently use FFSv1 or FFSv2
 1.104  11-Apr-2009  lukem fix sign-compare issues
 1.103  03-Apr-2009  pooka Issue a better error message if attempting to create a file system
on a block device. Inspired by PR kern/41127.
 1.102  01-Aug-2008  simonb branches: 1.102.2; 1.102.4; 1.102.8;
Handle 't' suffix for terabytes for number arguments.
 1.101  20-Jul-2008  lukem Remove the \n and tabs from the __COPYRIGHT() strings.
(Tweak some to use a consistent format.)
 1.100  15-Dec-2007  perry branches: 1.100.4; 1.100.8;
convert __attribute__s to applicable cdefs.h macros
 1.99  16-Jul-2007  pooka branches: 1.99.4; 1.99.6;
Make all mount(2) return value error checks against -1. Some file
systems just checked != 0, breaking MNT_GETARGS. Others worked with < 0,
but make them check against -1 too for consistency. And sprinkle some
stylish line wrapping where appropriate.
 1.98  14-Jul-2007  dsl Add additional 'sizeof args' parameter to mount(2).
 1.97  28-Apr-2007  christos PR/36229: Geoff Wing: uninitialized dkwedge_info structure in mount_mfs
causes random failures
 1.96  25-Nov-2006  christos PR/28884: Izumi Tsutsui: mount_mfs(8) doesn't set default fssize if "swap" is
specified
 1.95  16-Oct-2006  christos c99 initializers.
 1.94  27-Aug-2006  christos Make the "traditional" comment match reality.
 1.93  27-Aug-2006  christos Don't hard-code 3. From our secret user.
 1.92  26-Aug-2006  christos - Deal with wedges and the new disk geometry structures, instead of using
struct disklabel.

Functionality lost:
1. struct disklabel used to be updated to contain bsize, fsize, cpg.
This information was used to locate the alternative superblock in
the filesystem if the primary superblock was corrupted. We need
to find a new place to store this information if we need this
functionality.
2. On vax SMD drives that contained bad sector lists, the newfs program
knew how to get the offset and skip to the correct location in order
to place the label.
 1.91  04-May-2006  christos Since MNT_GETARGS is not allowed when any other flags are set, don't set
ASYNC in the getargs case.
 1.90  21-Mar-2006  christos Always check the results of getmntopts() and free them.
 1.89  16-Jan-2006  dsl Add '-V' to usage output.
Correct a couple of comments.
 1.88  15-Jan-2006  dsl Add a '-V verbose' option that controls the amount of info writen to stdout.
0: No output. Default for mount_mfs unless -N specified
1: Output size of partition and cylinder groups.
2: Follow with a progress-bar line of dots (scaled to finish at RH margin)
3: Include a single line of alternate suberblock addresses before progress
bar. Default for newfs.
4: Output lots of lines of alternate superblock numbers that scroll madly
up the screen.
If -N given, newfs/mount_mfs exits before displaying any progress bar.
Output constrained (almost always) to 1 column less than the terminal width.
 1.87  28-Nov-2005  dsl Include the size we are trying to create in the 'partition to small'
error message.
 1.86  23-Sep-2005  jmmv Apply the NFS exports list rototill patch:

- Remove all NFS related stuff from file system specific code.
- Drop the vfs_checkexp hook and generalize it in the new nfs_check_export
function, thus removing redundancy from all file systems.
- Move all NFS export-related stuff from kern/vfs_subr.c to the new
file sys/nfs/nfs_export.c. The former was becoming large and its code
is always compiled, regardless of the build options. Using the latter,
the code is only compiled in when NFSSERVER is enabled. While doing this,
also make some functions in nfs_subs.c conditional to NFSSERVER.
- Add a new command in nfssvc(2), called NFSSVC_SETEXPORTSLIST, that takes a
path and a set of export entries. At the moment it can only clear the
exports list or append entries, one by one, but it is done in a way that
allows setting the whole set of entries atomically in the future (see the
comment in mountd_set_exports_list or in doc/TODO).
- Change mountd(8) to use the nfssvc(2) system call instead of mount(2) so
that it becomes file system agnostic. In fact, all this whole thing was
done to remove a 'XXX' block from this utility!
- Change the mount*, newfs and fsck* userland utilities to not deal with NFS
exports initialization; done internally by the kernel when initializing
the NFS support for each file system.
- Implement an interface for VFS (called VFS hooks) so that several kernel
subsystems can run arbitrary code upon receipt of specific VFS events.
At the moment, this only provides support for unmount and is used to
destroy NFS exports lists from the file systems being unmounted, though it
has room for extension.

Thanks go to yamt@, chs@, thorpej@, wrstuden@ and others for their comments
and advice in the development of this patch.
 1.85  15-Nov-2004  he branches: 1.85.2;
Add a cast to unsigned char when using a ctype function/macro.
 1.84  07-Sep-2004  lukem fix typo
 1.83  25-Jun-2004  wiz Remove last traces of -c, for which the code was removed
last summer; addresses part of PR 25914 by Kouichirou Hiratsuka.
 1.82  21-Apr-2004  christos Replace the statfs() family of system calls with statvfs().
Retain binary compatibility.
 1.81  18-Mar-2004  dsl Simplify logic for MNT_GETARGS and MNT_UPDATE of mfs filesystems.
Stop core dump caused by broken 'newfs -mfs' (= mount_mfs) hack when
newfs run with no arguments.
 1.80  07-Mar-2004  dsl Re-instate the old behaviour where 'mount_mfs device mount_pt' would
use the size of 'device' for teh file syste size - fixes pr 18353.
(It might be better to be able to say 50% of the size...)
Fix 'mount_mfs -N ...', as well as supressing the creation of the fs, the -N
inhibits the supression of the prints of the mfs parameters.
 1.79  07-Mar-2004  dsl Make update mounts (to change miniroot ramdisks to rw) take the same short
circuit as MNT_GETARGS.
Fixes PR#24533
 1.78  22-Dec-2003  jmmv Fix typo: numder -> number. From Christian Biere in PR bin/23838.
 1.77  11-Dec-2003  drochner If a disktype was specified, use the disktab information
and don't try the disklabel.
Allows to create a filesystem on a floppy again.
(It is arguably another bug that DIOCGDINFO returns nonsense
for floppies.)
 1.76  01-Nov-2003  wiz KNF: sort includes.
 1.75  01-Nov-2003  dsl Use fstat(2) to get the partition size (falling back to the label on old
kernels) so that newfs works on vinum (and similar).
Kill the -V hack for vinum.
Don't bother faking up a label for -F and mfs, nothing is needed from it.
Ignore label if special doesn't match DISKPART(sb.st_rdev);
Simplifly logic for default block/frag sizes.
Update man page to match.
WARNS=3.
 1.74  15-Oct-2003  dbj initialize llsize and llsizemult to 0
fixes bug noticed by Christopher SEKIYA on tech-kern@
 1.73  10-Oct-2003  wiz Sync look of -V description in usage with other option descriptions.
 1.72  10-Oct-2003  grog Add -V flag for use with Vinum to indicate that the last character of
the device name should not be interpreted as a partition identifier.
 1.71  09-Oct-2003  dbj calculate "-s size" values after sectorsize has been fully determined
extend "-s size" argument to allow negative sizes to represent value to
subtract from diskalbel partition size
 1.70  11-Sep-2003  dsl Make mkfs -N work again (was trying to read filesystem).
Correct calculation of number of inodes from density for small filesystems.
Add a '-n inodes' option so that the desired number of inodes can be
explicitly given - init needs this for mfs /dev, -i density is too crude.
 1.69  03-Sep-2003  dsl Ensure the area between the end of the main superblock and the start of the
first alternate superblock is zerod.
Removes any possibility of any programs using a trully out of date
alternate superblock if a filesystem is remade with a larger block size.
 1.68  21-Aug-2003  dsl Remove -c maxblkspercg (leaving -c xxx ignored).
-c used to specify the number of cylinders per group
- but newfs has ignored cylinders for a while.
Changing what -c meant is just asking for trouble!
I might add something to let MINCYL be changed.
 1.67  07-Aug-2003  agc Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22308, verified by myself.
 1.66  13-Jul-2003  itojun use bounded string op
 1.65  02-Apr-2003  dbj On Apple UFS filesystems, change the default fragment size to 1024
and the default block size to 4096. Issue a warning if values
are used that will not work on Darwin.
 1.64  02-Apr-2003  fvdl Add support for UFS2. UFS2 is an enhanced FFS, adding support for
64 bit block pointers, extended attribute storage, and a few
other things.

This commit does not yet include the code to manipulate the extended
storage (for e.g. ACLs), this will be done later.

Originally written by Kirk McKusick and Network Associates Laboratories for
FreeBSD.
 1.63  24-Jan-2003  fvdl Bump daddr_t to 64 bits. Replace it with int32_t in all places where
it was used on-disk, so that on-disk formats remain the same.
Remove ufs_daddr_t and ufs_lbn_t for the time being.
 1.62  12-Dec-2002  scw Use getlabeloffset() instead of LABELOFFSET.
 1.61  28-Sep-2002  dbj Add support for the Apple UFS variation on ffs
This is the bulk of PR #17345

The general approach is to use a run time deteriminable value
for DIRBLKSIZ. Additional allowances are included for using
MAXSYMLINKLEN with FS_42INODEFMT and a shift in the cylinder group
cluster summary count array. Support is added for managing
the Apple UFS volume label.
 1.60  21-Sep-2002  christos MNT_GETARGS support
 1.59  08-Aug-2002  soren Remove extraneous \n's in {err,warn}{,x} that used to be printfs.
 1.58  20-Feb-2002  lukem change the default back to checking the file system type is '4.2BSD',
and add -I to ignore this check. per discussion with thorpej.
 1.57  16-Feb-2002  thorpej * Undo rev 1.55. While one might think this test is useful, newfs
has historically allowed file systems to be created on non-4.2BSD
partitions, and the ability to do so is quite useful to some people.
* When rewriting the disklabel, don't consider it an error if there's
not a label already on the disk (and thus the rewrite operation fails).
 1.56  18-Jan-2002  lukem fix this if MFS is not #defined
 1.55  15-Jan-2002  lukem If -F isn't given, only newfs(8) partitions of type `4.2BSD'.
 1.54  07-Jan-2002  simonb Add the ability for the user, group and permissions of an MFS to be set
on the command line with the -u, -g and -p options respectively.
The old malloc() replacement (and related functions) didn't work with
the libc get{pw,gr}nam() functions so it was removed and a separate
memory allocation function added that is only called to allocate the
space for the MFS file system.
Also use a table for the usage flags instead of multiple fprintf()'s
with "if (mfs)" checks sprinkled through.
 1.53  30-Dec-2001  augustss Change how default block size is picked. The default block size is used
if there is no command line option and the disklabel gives 0 as the size.
The default used to be 8k, not the default is picked depending on the
file system size. FS < 20M gets 4k, <1G get 8k, and >1G get 16k.
The 16k default was suggested by lukem which FreeBSD is using.
 1.52  30-Dec-2001  lukem Revert rev 1.37 (use disklabel value for cpg if -c isn't given), because
we would rather let the "optimal cpg" calculation kick in at this point.
 1.51  30-Dec-2001  lukem Fixes from and/or inspired by FreeBSD:
- Change the default cpg from 16 to 65536, which effectively means
that the largest allowable value for cpg will be computed if it's
not specified with -c or in the disklabel for that partition.
This is much more convenient for users.
- Improve the description of the defaults for various options
 1.50  13-Dec-2001  lukem constrain bsize and fsize to MAXBSIZE
 1.49  21-Nov-2001  lukem - For mount_mfs, always ignore the `special' field and just fake up
the label instead. The previous change to use opendisk() prevented
this from working with special fields such as `/dev/wd0b', and this
new method is arguably cleaner anyway. Fixes [misc/14654]
- Don't bother supporting -T for mount_mfs anymore, since it's
superfluous. The option still works (for compatibility reasons), but
it's just ignored and not documented anymore.
- Use an RPM of 10000 instead of 3600 for the fake label (why not :-)
 1.48  16-Nov-2001  lukem - Without -F, use opendisk(3) to find the raw device
- With -F, relax the restriction that the filesystem must be a regular file
 1.47  06-Sep-2001  lukem Incorporate the enhanced ffs_dirpref() by Grigoriy Orlov, as found in
FreeBSD (three commits; the initial work, man page updates, and a fix
to ffs_reload()), with the following differences:
- Be consistent between newfs(8) and tunefs(8) as to the options which
set and control the tuning parameters for this work (avgfilesize & avgfpdir)
- Use u_int16_t instead of u_int8_t to keep track of the number of
contiguous directories (suggested by Chuck Silvers)
- Work within our FFS_EI framework
- Ensure that fs->fs_maxclusters and fs->fs_contigdirs don't point to
the same area of memory

The new algorithm has a marked performance increase, especially when
performing tasks such as untarring pkgsrc.tar.gz, etc.

The original FreeBSD commit messages are attached:

=====
mckusick 2001/04/10 01:39:00 PDT
Directory layout preference improvements from Grigoriy Orlov <gluk@ptci.ru>.
His description of the problem and solution follow. My own tests show
speedups on typical filesystem intensive workloads of 5% to 12% which
is very impressive considering the small amount of code change involved.

------

One day I noticed that some file operations run much faster on
small file systems then on big ones. I've looked at the ffs
algorithms, thought about them, and redesigned the dirpref algorithm.

First I want to describe the results of my tests. These results are old
and I have improved the algorithm after these tests were done. Nevertheless
they show how big the perfomance speedup may be. I have done two file/directory
intensive tests on a two OpenBSD systems with old and new dirpref algorithm.
The first test is "tar -xzf ports.tar.gz", the second is "rm -rf ports".
The ports.tar.gz file is the ports collection from the OpenBSD 2.8 release.
It contains 6596 directories and 13868 files. The test systems are:

1. Celeron-450, 128Mb, two IDE drives, the system at wd0, file system for
test is at wd1. Size of test file system is 8 Gb, number of cg=991,
size of cg is 8m, block size = 8k, fragment size = 1k OpenBSD-current
from Dec 2000 with BUFCACHEPERCENT=35

2. PIII-600, 128Mb, two IBM DTLA-307045 IDE drives at i815e, the system
at wd0, file system for test is at wd1. Size of test file system is 40 Gb,
number of cg=5324, size of cg is 8m, block size = 8k, fragment size = 1k
OpenBSD-current from Dec 2000 with BUFCACHEPERCENT=50

You can get more info about the test systems and methods at:
http://www.ptci.ru/gluk/dirpref/old/dirpref.html

Test Results

tar -xzf ports.tar.gz rm -rf ports
mode old dirpref new dirpref speedup old dirprefnew dirpref speedup
First system
normal 667 472 1.41 477 331 1.44
async 285 144 1.98 130 14 9.29
sync 768 616 1.25 477 334 1.43
softdep 413 252 1.64 241 38 6.34
Second system
normal 329 81 4.06 263.5 93.5 2.81
async 302 25.7 11.75 112 2.26 49.56
sync 281 57.0 4.93 263 90.5 2.9
softdep 341 40.6 8.4 284 4.76 59.66

"old dirpref" and "new dirpref" columns give a test time in seconds.
speedup - speed increasement in times, ie. old dirpref / new dirpref.

------

Algorithm description

The old dirpref algorithm is described in comments:

/*
* Find a cylinder to place a directory.
*
* The policy implemented by this algorithm is to select from
* among those cylinder groups with above the average number of
* free inodes, the one with the smallest number of directories.
*/

A new directory is allocated in a different cylinder groups than its
parent directory resulting in a directory tree that is spreaded across
all the cylinder groups. This spreading out results in a non-optimal
access to the directories and files. When we have a small filesystem
it is not a problem but when the filesystem is big then perfomance
degradation becomes very apparent.

What I mean by a big file system ?

1. A big filesystem is a filesystem which occupy 20-30 or more percent
of total drive space, i.e. first and last cylinder are physically
located relatively far from each other.
2. It has a relatively large number of cylinder groups, for example
more cylinder groups than 50% of the buffers in the buffer cache.

The first results in long access times, while the second results in
many buffers being used by metadata operations. Such operations use
cylinder group blocks and on-disk inode blocks. The cylinder group
block (fs->fs_cblkno) contains struct cg, inode and block bit maps.
It is 2k in size for the default filesystem parameters. If new and
parent directories are located in different cylinder groups then the
system performs more input/output operations and uses more buffers.
On filesystems with many cylinder groups, lots of cache buffers are
used for metadata operations.

My solution for this problem is very simple. I allocate many directories
in one cylinder group. I also do some things, so that the new allocation
method does not cause excessive fragmentation and all directory inodes
will not be located at a location far from its file's inodes and data.
The algorithm is:
/*
* Find a cylinder group to place a directory.
*
* The policy implemented by this algorithm is to allocate a
* directory inode in the same cylinder group as its parent
* directory, but also to reserve space for its files inodes
* and data. Restrict the number of directories which may be
* allocated one after another in the same cylinder group
* without intervening allocation of files.
*
* If we allocate a first level directory then force allocation
* in another cylinder group.
*/

My early versions of dirpref give me a good results for a wide range of
file operations and different filesystem capacities except one case:
those applications that create their entire directory structure first
and only later fill this structure with files.

My solution for such and similar cases is to limit a number of
directories which may be created one after another in the same cylinder
group without intervening file creations. For this purpose, I allocate
an array of counters at mount time. This array is linked to the superblock
fs->fs_contigdirs[cg]. Each time a directory is created the counter
increases and each time a file is created the counter decreases. A 60Gb
filesystem with 8mb/cg requires 10kb of memory for the counters array.

The maxcontigdirs is a maximum number of directories which may be created
without an intervening file creation. I found in my tests that the best
performance occurs when I restrict the number of directories in one cylinder
group such that all its files may be located in the same cylinder group.
There may be some deterioration in performance if all the file inodes
are in the same cylinder group as its containing directory, but their
data partially resides in a different cylinder group. The maxcontigdirs
value is calculated to try to prevent this condition. Since there is
no way to know how many files and directories will be allocated later
I added two optimization parameters in superblock/tunefs. They are:

int32_t fs_avgfilesize; /* expected average file size */
int32_t fs_avgfpdir; /* expected # of files per directory */

These parameters have reasonable defaults but may be tweeked for special
uses of a filesystem. They are only necessary in rare cases like better
tuning a filesystem being used to store a squid cache.

I have been using this algorithm for about 3 months. I have done
a lot of testing on filesystems with different capacities, average
filesize, average number of files per directory, and so on. I think
this algorithm has no negative impact on filesystem perfomance. It
works better than the default one in all cases. The new dirpref
will greatly improve untarring/removing/coping of big directories,
decrease load on cvs servers and much more. The new dirpref doesn't
speedup a compilation process, but also doesn't slow it down.

Obtained from: Grigoriy Orlov <gluk@ptci.ru>
=====

=====
iedowse 2001/04/23 17:37:17 PDT
Pre-dirpref versions of fsck may zero out the new superblock fields
fs_contigdirs, fs_avgfilesize and fs_avgfpdir. This could cause
panics if these fields were zeroed while a filesystem was mounted
read-only, and then remounted read-write.

Add code to ffs_reload() which copies the fs_contigdirs pointer
from the previous superblock, and reinitialises fs_avgf* if necessary.

Reviewed by: mckusick
=====

=====
nik 2001/04/10 03:36:44 PDT
Add information about the new options to newfs and tunefs which set the
expected average file size and number of files per directory. Could do
with some fleshing out.
=====
 1.46  30-Aug-2001  lukem some improvements from freebsd/openbsd
- replace the unused fs_headswitch and fs_trkseek with fs_id[2], bringing
our struct fs closer to that in freebsd & openbsd (& solaris FWIW)
- dumpfs: improve warning message when cpc == 0
 1.45  08-Aug-2001  lukem when zeroing the image, use fstatfs() to find the optimal block size
(falling back to 8KB) instead of 512. should speed things up.
 1.44  30-Jul-2001  lukem - constify mkfs()'s first arg
- slightly reorder steps in -F image creation
 1.43  29-Jul-2001  lukem * add -F option: enable creation of file system in a regular file. a "fake"
disklabel is created as per mfs on "swap".
* add -Z option: pre-zero the -F image file before use. this is necessary if
the image is to be used with vnd(4) because by default the files created
with -F have "holes" and vnd doesn't cope with that.
* support 'k', 'm', 'g' suffixes for all options which take numeric arguments.
provide strsuftoi() which performs the parsing mechanism.
* improve man page description of various options
* replace "filesystem" with "file system"
* when displaying usage for mfs, only list mfs options
* minor KNF and WARNS=2 cleanups
 1.42  19-Feb-2001  cgd convert to use getprogname()
 1.41  01-Dec-2000  simonb For mount_mfs, allow an 'm' suffix to the file system size option to
specify the size of the mfs in megabytes.

Inspired by the Solaris tmpfs "-o size=sz" option.
 1.40  01-Dec-2000  simonb ANSIfy.
 1.39  10-Oct-2000  is Format string cleanups by Bill Sommerfeld.
 1.38  19-May-1999  wrstuden branches: 1.38.8;
If -c not set on command line and the partition has a non-zero cpg
value, use it for the number of cylinders per group. So now the value
in the disklabel does something. :-)
 1.37  19-Jan-1999  tron branches: 1.37.2;
Include "disktab.h" to get prototype for getdiskbyname().
 1.36  22-Oct-1998  mycroft Use the default calculation of maxcontig, based on fs_bsize and MAXPHYS, so
that the cluster summary information is correct for bsize=4k and MAXPHYS=64k.
 1.35  20-Oct-1998  matt vax -> __vax__
 1.34  28-Jul-1998  mycroft __AUDIT__ cleanup.
 1.33  18-Mar-1998  bouyer Allow creation of non-native byteorder FFS (via the '-B' option).
 1.32  01-Mar-1998  fvdl Merge with Lite2 + local changes
 1.31  19-Nov-1997  drochner mount_mfs: avoid spurious error message if the mount system call returns
for "valid reasons" (ie, "mount -u")
 1.30  01-Nov-1997  drochner Make "mount_mfs" behave synchronously - don't exit before the mount is
done. This has 2 advantages:
-The calling process can rely on the mounted filesystem.
-We get error messages if the mount system call fails.
 1.29  01-Oct-1997  enami branches: 1.29.2;
Don't declare optind and optarg.
 1.28  29-Sep-1997  enami When calling err(3),
- Don't output unnecessary colon and space, and
- Include the name of system call just called.
 1.27  16-Sep-1997  lukem * resolve conflicts from lite-2 import
* use int32_t instead of long
 1.26  15-Sep-1997  lukem * getopt returns -1 not EOF
* fix .Nm usage
 1.25  30-Jun-1997  christos Fix compiler warnings.
 1.24  30-Jun-1997  tls I don't understand just what exactly changed in the past week that the GDINFO ioctl call here would smash the value of 'fd' and fail, but making fd volatile seems to fix it, for this program at least.
 1.23  30-Jan-1997  tls add support for noatime mount flag
 1.22  23-Oct-1996  cgd this file system (according to its source) supports MNT_UPDATE. Therefore
the mount program must recognize the 'update' option.
 1.21  18-Oct-1996  perry Remove #ifdef tahoe conditionals. We have no tahoe port. There is
still a big #if vax in this file which should be removed if possible --
#ifdef MACHINE stuff in mi code is bad.
 1.20  16-May-1996  thorpej Use getmaxpartitions() from libutil, not a homegrown version.
 1.19  28-Jun-1995  thorpej Use sysctl() to determine maxpartitions. Fixes pr #970.
 1.18  18-Mar-1995  cgd convert to new RCS Id conventions; reduce my headache
 1.17  18-Mar-1995  cgd calculate the 'offset' argument to lseek() in a prettier way, more
consistent with the way fsck(8) does it. no functional change.
 1.16  04-Mar-1995  cgd fix up inconsisten uses of lseek(). (three uses. one hard-coded 'whence'
as a number, one used an L_ constant and the other used a SEEK_ constant!)
 1.15  30-Jan-1995  mycroft Use S_IS*().
 1.14  18-Dec-1994  cgd type size paranoia, and allow one to mount an mfs on the device 'swap',
so that diskless machines can use MFS /tmp directories.
 1.13  01-Dec-1994  mycroft Use defaults that are more reasonable for modern disks, and document the `-n'
option.
 1.12  23-Sep-1994  mycroft Remove some more uses of obsolete functions.
 1.11  23-Sep-1994  mycroft Eliminate uses of some obsolete functions.
 1.10  08-Jun-1994  mycroft Update from 4.4-Lite, with local changes.
 1.9  20-Apr-1994  cgd back to 10%, per mkm
 1.8  06-Feb-1994  cgd numeric -> symbolic constant
 1.7  28-Jan-1994  cgd MINFREE defaults to 5% per mckusick
 1.6  01-Aug-1993  mycroft Add RCS identifiers.
 1.5  28-Jul-1993  cgd incorporate changes from 0-9-base to 0-9-ALPHA
 1.4  18-Apr-1993  mycroft branches: 1.4.2;
Don't mix ANSI and pre-ANSI varargs.
 1.3  23-Mar-1993  cgd changed "Id" to "Header" for rcsids
 1.2  22-Mar-1993  cgd added rcs ids to all files
 1.1  21-Mar-1993  cgd branches: 1.1.1;
Initial revision
 1.1.1.3  16-Sep-1997  lukem imported from lite-2
 1.1.1.2  13-Jun-1994  mycroft Import 4.4-Lite version.
 1.1.1.1  21-Mar-1993  cgd initial import of 386bsd-0.1 sources
 1.4.2.2  21-Jul-1993  cgd in the last round: one of my changes was wrong, one was ugly.
 1.4.2.1  20-Jul-1993  cgd change all refs to "mfs" to be to "mount_mfs" as is appropriate
 1.29.2.3  23-Oct-1998  cgd pull up rev 1.36 from trunk (mycroft)
 1.29.2.2  19-Nov-1997  mellon Pull rev 1.31 up from trunk (drochner)
 1.29.2.1  02-Nov-1997  mellon Pull rev 1.30 up from trunk (drochner)
 1.37.2.1  10-Oct-2000  he Pull up revision 1.39 (requested by is):
Format string cleanup.
 1.38.8.4  25-Nov-2001  he Pull up revision 1.47 (via patch, requested by lukem):
Pull in enhanced ffs_dirpref() algorithm, which provides a
substantial performance improvement through better locality
between parent/child directories and their files, and by easing
the pressure on the buffer cache for metadata operations.
 1.38.8.3  25-Nov-2001  he Pull up revision 1.46 (requested by lukem):
Replace unused fs_headswitch/trkseek with fs_id.
 1.38.8.2  24-Nov-2001  he Pull up revisions 1.40-1.41 (requested by lukem):
Jumbo pullup for newfs:
o convert to ANSI function prototypes
o allow ``m'' suffix in MFS size
 1.38.8.1  18-Oct-2000  tv Pullup sbin string format fixes [is].
See "cvs log" for explicit revision numbers per file, from sommerfeld.
 1.85.2.1  03-Mar-2007  bouyer Pull up following revision(s) (requested by tsutsui in ticket #1672):
sbin/newfs/newfs.c: revision 1.96
PR/28884: Izumi Tsutsui: mount_mfs(8) doesn't set default fssize if "swap" is
specified
 1.99.6.1  27-Dec-2007  mjf Sync with HEAD.
 1.99.4.1  09-Jan-2008  matt sync with HEAD
 1.100.8.1  18-Sep-2008  wrstuden Sync with wrstuden-revivesa-base-2.
 1.100.4.1  28-Sep-2008  mjf Sync with HEAD.
 1.102.8.1  21-Apr-2010  matt sync to netbsd-5
 1.102.4.1  13-May-2009  jym Sync with HEAD.

Third (and last) commit. See http://mail-index.netbsd.org/source-changes/2009/05/13/msg221222.html
 1.102.2.1  10-Jun-2009  bouyer Pull up following revision(s) (requested by snj in ticket #803):
sbin/newfs/newfs.c: revision 1.103
Issue a better error message if attempting to create a file system
on a block device. Inspired by PR kern/41127.
 1.108.2.1  20-Jan-2011  bouyer Snapshot of work in progress on a modernised disk quota system:
- new quotactl syscall (versionned for backward compat), which takes
as parameter a path to a mount point, and a prop_dictionary
(in plistref format) describing commands and arguments.
For each command, status and data are returned as a prop_dictionary.
quota commands features will be added to take advantage of this,
exporting quota data or getting quota commands as plists.

- new on disk-format storage (all 64bit wide), integrated to metadata for
ffs (and playing nicely with wapbl).
Quotas are enabled on a ffs filesystem via superblock flags.
tunefs(8) can enable or disable quotas.
On a quota-enabled filesystem, fsck_ffs(8) will track per-uid/gid
block and inode usages, and will check and update quotas in Pass 6.
quota usage and limits are stored in unliked files (one for users,
one for groups)l fsck_ffs(8) will create the files if needed, or
free them if needed. This means that after enabling or disabling
quotas on a filesystem; a fsck_ffs(8) run is required.
quotacheck(8) is not needed any more, on a unclean shutdown
fsck or journal replay will take care of fixing quotas.
newfs(8) can create a ready-to-mount quota-enabled filesystem
(superblock flags are set and quota inodes are created).
Other new features or semantic changes:
- default quota datas, applied to users or groups which don't already
have a quota entry
- per-user/group grace time (instead of a filesystem global one)
- 0 really means "nothing allowed at all", not "no limit".
If you want "no limit", set the limit to UQUAD_MAX (tools will
understand "unlimited" and "-")

A quota file is structured as follow:
it starts with a header, containing a few per-filesystem values,
and the default quota limits.
Quota entries are linked together as a simple list, each entry has a
pointer (as an offset withing the file) to the next.
The header has a pointer to a list of free quota entries, and
a hash table of in-use entries. The size of the hash table depends
on the filesystem block size (header+hash table should fit in the
first block). The file is not sparse and is a multiple of
filesystem block size (when the free quota entry list is empty a new
filesystem block is allocated). quota entries to not cross
filesystem block boundaries.

In memory, the kernel keeps a cache of recently used quota entries
as a reference to the block number, and offset withing the block.
The quota entry itself is keept in the buf cache.

fsck_ffs(8), tunefs(8) and newfs(8) supports are completed (with
related atf tests :)
The kernel can update disk usage and report it via quotactl(2).

Todo: enforce quotas limits (limits are not checked by kernel yet)
update repquota, edquota and rpc.rquotad to the new world
implement compat_50_quotactl ioctl.
update quotactl(2) man page

fsck_ffs required fixes so that allocating new blocks or inodes will
properly update the superblock and cg sumaries. This was not an issue up
to now because superblock and cg sumaries check happened last, but now
allocations or frees can happen in pass 6.
 1.109.4.2  30-Oct-2012  yamt sync with head
 1.109.4.1  17-Apr-2012  yamt sync with head
 1.110.2.1  05-Jul-2012  riz Pull up following revision(s) (requested by tsutsui in ticket #396):
sbin/newfs/newfs.8: revision 1.83
sbin/newfs/newfs.c: revision 1.111
distrib/utils/sysinst/label.c: revision 1.62
Use 32KB/4KB for default block/fragment size on >= 128 GB partitions
for modern AFT disks. No particular comments against PR install/46629.
 1.111.10.2  30-Jul-2015  snj Pull up following revision(s) (requested by mlelstv in ticket #900):
sbin/newfs/newfs.c: revision 1.113
usr.sbin/installboot/installboot.c: revision 1.39
Handle getfsspecname errors.
 1.111.10.1  11-Nov-2014  martin Pull up following revision(s) (requested by mlelstv in ticket #199):
sbin/newfs/newfs.c: revision 1.112
sbin/fsck/fsck.c: revision 1.52
fix logic that handles command line arguments. Now you can:
fsck /mnt/point
fsck dkX
fsck rdkX
fsck /dev/dkX
fsck /dev/rdkX
fsck NAME=wedge
Support wedge names.
before:
newfs dk1 - formats /dev/rdk1
newfs rdk1 - cannot open /dev/rrdk1
newfs /dev/dk1 - /dev/dk1 is a block-device, use raw device
newfs /dev/rdk1 - formats /dev/rdk1
now:
newfs dk1 - formats /dev/rdk1
newfs rdk1 - cannot open /dev/rrdk1
newfs /dev/dk1 - formats /dev/rdk1 (*)
newfs /dev/rdk1 - formats /dev/rdk1
newfs NAME=wedge - formats /dev/rdk1
(*) getfsspecname() returns the block device which must be translated.
Passing a block device manually cannot be distinguished from this case.
 1.114.4.1  21-Apr-2017  bouyer Sync with HEAD
 1.114.2.1  20-Mar-2017  pgoyette Sync with HEAD
 1.115.12.1  21-Apr-2020  martin Sync with HEAD

RSS XML Feed