hi @Senguttuvan, to get an additional label on top of each bar -  instead of using Caption Box (which will give put the label at the top of the graph) - Use another Bar Graph [hidden in the back] and activate the label there.
To get it right, you have to disable the overlay column:

(in JSL: don't use the overlay option for this bar graph)
With the additional label, the graph looks like this:

Now, the label "follows the line graph" like in your second example 
 
Names Default to Here(1);
dt = Open( "$SAMPLE_DATA/Big Class.jmp" );
Graph Builder(
	Variables( X( :sex ), Overlay( :age ) ),
	Elements(
		Bar(
			X,
			Overlay( 0 ),
			Summary Statistic( "% of Grand Total" ),
			Label( "Label by Value" )
		),
		Bar(
			X,
			Bar Style( "Stacked" ),
			Summary Statistic( "% of Grand Total" ),
			Label( "Label by Value" )
		)
	)
)